-- Logs begin at Mon 2022-10-10 11:19:26 UTC, end at Mon 2022-10-10 12:16:33 UTC. -- Oct 10 11:45:12.646154 dv-cinder-850618-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 10 11:45:12.654142 dv-cinder-850618-4-smb devstack@keystone.service[81394]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 11:45:12 2022] *** Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: nodename: dv-cinder-850618-4-smb Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: machine: x86_64 Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: clock source: unix Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: pcre jit disabled Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: detected number of CPU cores: 4 Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: current working directory: / Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: detected binary path: /usr/bin/uwsgi-core Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: your processes number limit is 47680 Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: your memory page size is 4096 bytes Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: detected max file descriptor number: 2048 Oct 10 11:45:12.656285 dv-cinder-850618-4-smb devstack@keystone.service[81394]: lock engine: pthread robust mutexes Oct 10 11:45:12.659022 dv-cinder-850618-4-smb devstack@keystone.service[81394]: thunder lock: enabled Oct 10 11:45:12.659022 dv-cinder-850618-4-smb devstack@keystone.service[81394]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 10 11:45:12.659022 dv-cinder-850618-4-smb devstack@keystone.service[81394]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 11:45:12.695220 dv-cinder-850618-4-smb devstack@keystone.service[81394]: Python main interpreter initialized at 0x5628144169c0 Oct 10 11:45:12.695220 dv-cinder-850618-4-smb devstack@keystone.service[81394]: python threads support enabled Oct 10 11:45:12.695220 dv-cinder-850618-4-smb devstack@keystone.service[81394]: your server socket listen backlog is limited to 100 connections Oct 10 11:45:12.695220 dv-cinder-850618-4-smb devstack@keystone.service[81394]: your mercy for graceful operations on workers is 90 seconds Oct 10 11:45:12.695583 dv-cinder-850618-4-smb devstack@keystone.service[81394]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 11:45:12.695675 dv-cinder-850618-4-smb devstack@keystone.service[81394]: *** Operational MODE: preforking *** Oct 10 11:45:12.695898 dv-cinder-850618-4-smb devstack@keystone.service[81394]: *** uWSGI is running in multiple interpreter mode *** Oct 10 11:45:12.695898 dv-cinder-850618-4-smb devstack@keystone.service[81394]: spawned uWSGI master process (pid: 81394) Oct 10 11:45:12.696100 dv-cinder-850618-4-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 10 11:45:12.698041 dv-cinder-850618-4-smb devstack@keystone.service[81394]: spawned uWSGI worker 1 (pid: 81408, cores: 1) Oct 10 11:45:12.698041 dv-cinder-850618-4-smb devstack@keystone.service[81394]: spawned uWSGI worker 2 (pid: 81409, cores: 1) Oct 10 11:45:12.698041 dv-cinder-850618-4-smb devstack@keystone.service[81394]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 11:45:16.955107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:45:16.955107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: from cryptography.utils import int_from_bytes Oct 10 11:45:16.955880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:45:16.955880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: from cryptography.utils import int_from_bytes Oct 10 11:45:16.956024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:45:16.956024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: from cryptography.utils import int_from_bytes Oct 10 11:45:16.956024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 11:45:16.956024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: from cryptography.utils import int_from_bytes Oct 10 11:45:17.005117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:45:17.005310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:45:17.005501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] command line args: [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:45:17.005769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:45:17.005948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ================================================================================ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:45:17.006201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] admin_token = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.006446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_dir = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.006633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.006814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_source = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.006971 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 11:45:17.007056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] debug = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.007168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 11:45:17.007257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.007434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] command line args: [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 11:45:17.007560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.007643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 11:45:17.007709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.007779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ================================================================================ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 11:45:17.007949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] admin_token = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_dir = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_config_append = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_source = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.008911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] debug = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.009056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_dir = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.009171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.009301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.009400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.009525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.009681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.009809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.009923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_config_append = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.010875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_dir = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.011086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.011207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.011326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.011446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.011566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.011683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.011808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.011929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.012785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] publish_errors = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.013958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.014071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.014190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.014320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.014442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.014556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.014675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.014675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] standard_threads = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.014887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] publish_errors = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015261 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_journal = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_json = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.015974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_stderr = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.016187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.016299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_syslog = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.016412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.016530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.016723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] standard_threads = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.016842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.016962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.017102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.017217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.017330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.017455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.017455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_journal = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.017671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.017784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_json = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.017903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.018023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_stderr = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.018023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_syslog = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.018252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.018366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 11:45:17.018485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.018600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.018719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.018841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.018956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.018956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.019167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.019167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.019429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.019429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.019664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.019779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.019892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.020905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.021052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.021052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.021266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.021378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.021502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.021627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.021749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.021863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.022009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.022124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.022314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.022430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.022559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.022674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.022788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.022788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.023947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.024066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.024179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.024299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.024422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.024538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.024650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.024769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.024889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.025964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.026082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.026203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.026317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.026431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.026554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.026669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.026780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.026892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027005 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.027994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.028110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.028223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.028342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.028463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.028577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.028701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.028816 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.028934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029379 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.029967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.030100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.030278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.030436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.030555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.030679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.030794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.030907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.031905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.032946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.033117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.033233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.033347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.033461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.033592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.033720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.033836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.033949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.034979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.035101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.035207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.035321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.035435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.035555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.035670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.035792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.035899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.036942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.037081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.037206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.037322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.037438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.037559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.037681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.037797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.037922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.038962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.039076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.039207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.039401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.039521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.039641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.039757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.039871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.039996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.040120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.040244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.040360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.040474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.040590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.040704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.040818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.040940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.041089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.041204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.041329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.041445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.041559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.041685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.041801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.041928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.042044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.042158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.external = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.042271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.042397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.042514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.042637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.042754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.042868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043135 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.password = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.token = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.043961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.044084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.044201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.external = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.044316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.044432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.044546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.044662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.044788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.044905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.045072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.045191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.password = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.045307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.045422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.token = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.045551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.046162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.046290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.046407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.046522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.046637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.046765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.046883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.046998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.047112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.047227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.047341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.047465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.047582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.047697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.047819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.047937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.048052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.048176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.048302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.048419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.048535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.048651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.048766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.048890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049396 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.049974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.050089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.050204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.050327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.050327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.050545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.050666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.050782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.050906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.051957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.052074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.052188 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.052313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.052429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.052544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.052658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.052773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.052888 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.053030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.053149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.053264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.053379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.053503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.053619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.053805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.053923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.054994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.055979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.056917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.057926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.058955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.059960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060437 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.060934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.061106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.061186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.061420 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.062992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.063110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.063225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.063357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.063474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.063605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.063723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.063852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.063960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.064085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.064197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.064314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.064435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.064549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.064666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.064783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.064905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.065038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.065192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.065273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.065424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.065503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.065674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.065753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.065970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.066049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.066216 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.066294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.066460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.066539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.066689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.066768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.066923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067617 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.067929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.068092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.068178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.068335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.068413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.068566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.068643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.068815 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.068894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.069063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.069145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.069307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.069386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.069541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.069621 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.069771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.069848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.070944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.071964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.072118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.072202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.072359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.072439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.072587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.072665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.072832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.072921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.073086 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.073166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.073322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.073400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.073556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.073648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.073800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.073879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.074974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.075061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.075218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.075298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.075453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.075532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.075690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.075778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.075924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.076950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.077162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.077254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.077410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.077549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.077658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.077783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.077905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.078997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.079124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.079247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.079370 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.079500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.079615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.079734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.079964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.080042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.080193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.080273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.080422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.080500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.080669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.080753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.080920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.081961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.082115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.082194 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.082350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.082431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.082578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.082656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.082809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.082888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.083059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.083139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.083303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.083380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.083538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.083617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.083770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.083849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.084922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.085990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.086141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.086219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.086400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.086479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.086636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.086723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.086867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.086945 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.087100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.087177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.087330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.087417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.087560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.087638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.087792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.087870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.088968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.089079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.089221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.089302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.089472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.089551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.089705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.089793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.089935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.090024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.090158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.090236 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.090391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.090479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.090619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.090697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.090789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:45:17.090878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.091080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.091321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.091553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.091801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.092037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.092280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.092509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.093296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.093531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 11:45:17.093701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 11:45:17.120791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.121046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.121274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.122305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.122538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.122765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.129510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.130973 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.157501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.157732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.159013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.159246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.209959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.210280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.258641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.258873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.259621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.259857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.413380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.413542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.413744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.413922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.414009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.414156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.414241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.414368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.414450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.414584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.414801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.415013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.437402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.437636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.437862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.437944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.438940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.439158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.449692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.449962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.462963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.463196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.463376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.463477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.463615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.463698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.463836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.463917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.464052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.464144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.464264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.464347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.464477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.464692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 10 11:45:17.481141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.481350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 11:45:17.481632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.481716 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.481843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 11:45:17.481941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 11:45:17.482133 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.482215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.482366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 10 11:45:17.482447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.482633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.482723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.482889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.482969 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.483146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.483442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.492283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.492563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.492833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.492914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.493140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.493277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.493411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.493701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.500230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.500805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.503105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.503390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.503671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.503752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.503948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.504031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.504228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.504310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.504483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.504563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.504751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.504833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.505050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.505136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.505322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.505403 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.505590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.505682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.505856 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.505936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.506128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.506398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.528742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.529200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.530748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.531033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.531192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.531477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.535623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.535909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.536076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.536189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.536361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.536645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.542424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.542712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.542867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.543155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.548270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.548568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.548780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.548863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.549099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.549184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.549389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.549472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.549676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.549758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.549947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.550036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.550214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.550296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.550480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.550747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.565423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.565702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.566067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.566345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.569523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.570404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.572688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.573001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.573628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.576162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.577849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.579860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.580923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.583237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.584106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.584405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.584692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.585012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.585281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.585558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.586474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.586779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.587070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.587362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.587660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.587953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.601556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.601845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.602114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.602382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.604112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.604414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.604673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.604939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.609106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.610635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.611774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.612131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.612413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.613349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.614908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.615066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.615186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.615359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.615639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.615919 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.616312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.617898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.618198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.618483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.618766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.619165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.627508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.627793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.628074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.628355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.628732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.629031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.629324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.630478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.630764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.631047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.631327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.631705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.631998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.632293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.644955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.647825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.647985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.650697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.650885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.652203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.653680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.653776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.653964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.654380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.655836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.657337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.657626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.658026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.661159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.662604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.664362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.665456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.665803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.665886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.666121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.666399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.668635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.669062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.669403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.669640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.674098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.674388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.674669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.677384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.677682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.677963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.681399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.681683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.681961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.682249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.682528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.682797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.683067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.683340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.683606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.683894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.684178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.684438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.684700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.684795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 10 11:45:17.684965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.685076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.685310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.685588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.685864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.686138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.686440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.686724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.687008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.687288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.687575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.687838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.688101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.688369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 10 11:45:17.719102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628144169c0 pid: 81408 (default app) Oct 10 11:45:17.722331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ae206-cfb1-45f6-bfc2-ccebaf81d97d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:17.722622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ae206-cfb1-45f6-bfc2-ccebaf81d97d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:17.722889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5628144169c0 pid: 81409 (default app) Oct 10 11:45:17.722974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ae206-cfb1-45f6-bfc2-ccebaf81d97d None None] PATH_INFO: `/v3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:17.726992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Mon Oct 10 11:45:17 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:24.412138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a9ae-d1c5-4b3d-b342-54c99e6142f5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:24.412685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a9ae-d1c5-4b3d-b342-54c99e6142f5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:24.412685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a9ae-d1c5-4b3d-b342-54c99e6142f5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:24.416901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:24.422581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:24.423175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:24.423175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:24.492743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: INFO dbcounter [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] Registered counter for database keystone Oct 10 11:45:24.511992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG oslo_db.sqlalchemy.engines [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:45:24.518100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writer thread running {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:45:24.695610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG passlib.handlers.bcrypt [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81408) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 10 11:45:24.695916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG passlib.handlers.bcrypt [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81408) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 10 11:45:24.753816 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:24.755384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:24.882234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 10 11:45:25.363827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675a9ae-d1c5-4b3d-b342-54c99e6142f5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:25.434072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: INFO dbcounter [None req-f675a9ae-d1c5-4b3d-b342-54c99e6142f5 None None] Registered counter for database keystone Oct 10 11:45:25.456713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG oslo_db.sqlalchemy.engines [None req-f675a9ae-d1c5-4b3d-b342-54c99e6142f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 11:45:25.462841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writer thread running {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 11:45:25.579685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675a9ae-d1c5-4b3d-b342-54c99e6142f5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:25.583887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0bb5e-f8c9-48b3-b6f6-b86c94bacac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:25.584501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0bb5e-f8c9-48b3-b6f6-b86c94bacac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:25.584779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0bb5e-f8c9-48b3-b6f6-b86c94bacac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:25.585075 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0bb5e-f8c9-48b3-b6f6-b86c94bacac0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:25.593052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0bb5e-f8c9-48b3-b6f6-b86c94bacac0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:25.648282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ade0bb5e-f8c9-48b3-b6f6-b86c94bacac0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 10 11:45:25.648565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0bb5e-f8c9-48b3-b6f6-b86c94bacac0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:25.658249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Mon Oct 10 11:45:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 10 11:45:25.664197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:25.681143 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba7d20-a5c1-465a-96c2-4ac23ca6400f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:25.685530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2ae04-6766-4a4c-9a22-77b29992ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:25.686623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2ae04-6766-4a4c-9a22-77b29992ef04 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:25.686909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2ae04-6766-4a4c-9a22-77b29992ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:25.687779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2ae04-6766-4a4c-9a22-77b29992ef04 admin admin] PATH_INFO: `/v3/projects/46b9ca29061a40d98972b8db835132e5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:25.689417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2ae04-6766-4a4c-9a22-77b29992ef04 admin admin] RBAC: Authorizing `identity:get_project(project_id=46b9ca29061a40d98972b8db835132e5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:25.741226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING keystone.common.rbac_enforcer.enforcer [None req-87c2ae04-6766-4a4c-9a22-77b29992ef04 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 10 11:45:25.741589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2ae04-6766-4a4c-9a22-77b29992ef04 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:25.746272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Mon Oct 10 11:45:25 2022] GET /identity/v3/projects/46b9ca29061a40d98972b8db835132e5 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:27.841108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ee7e-cdbd-4ce2-8cd9-94303a703c30 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:27.841516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ee7e-cdbd-4ce2-8cd9-94303a703c30 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:27.841649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14ee7e-cdbd-4ce2-8cd9-94303a703c30 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:27.845826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:27.851275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72975-d9c2-4424-8088-7160721e49b8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:27.851700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72975-d9c2-4424-8088-7160721e49b8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:27.851839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72975-d9c2-4424-8088-7160721e49b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:27.871721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4cb72975-d9c2-4424-8088-7160721e49b8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:27.873274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4cb72975-d9c2-4424-8088-7160721e49b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:27.881534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 10 11:45:28.144774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14ee7e-cdbd-4ce2-8cd9-94303a703c30 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:28.157220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14ee7e-cdbd-4ce2-8cd9-94303a703c30 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:28.161354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36884c3-11ea-40eb-8ae0-8f56851aaba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:28.161942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36884c3-11ea-40eb-8ae0-8f56851aaba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:28.162220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36884c3-11ea-40eb-8ae0-8f56851aaba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:28.162492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36884c3-11ea-40eb-8ae0-8f56851aaba3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:28.170077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36884c3-11ea-40eb-8ae0-8f56851aaba3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:28.171845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36884c3-11ea-40eb-8ae0-8f56851aaba3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:28.180382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Mon Oct 10 11:45:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 11:45:28.185539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72975-d9c2-4424-8088-7160721e49b8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:28.194458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72975-d9c2-4424-8088-7160721e49b8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:28.198777 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861c81c-687d-4d3e-94ec-848b9af555d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:28.199402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c81c-687d-4d3e-94ec-848b9af555d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:28.199686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c81c-687d-4d3e-94ec-848b9af555d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:28.199965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c81c-687d-4d3e-94ec-848b9af555d8 admin admin] PATH_INFO: `/v3/users/c765c31c0c1d406383a20f8e12957d4e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:28.201314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861c81c-687d-4d3e-94ec-848b9af555d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=c765c31c0c1d406383a20f8e12957d4e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:28.203641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861c81c-687d-4d3e-94ec-848b9af555d8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:28.205184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Mon Oct 10 11:45:28 2022] GET /identity/v3/users/c765c31c0c1d406383a20f8e12957d4e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:30.369755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b48667-dd85-4678-91f4-620ef4d0b2d6 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:30.370264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b48667-dd85-4678-91f4-620ef4d0b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:30.370361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b48667-dd85-4678-91f4-620ef4d0b2d6 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:30.371868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:30.376924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5500e-38b2-4b5d-939f-c9ba14c801e1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:30.377371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5500e-38b2-4b5d-939f-c9ba14c801e1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:30.377506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5500e-38b2-4b5d-939f-c9ba14c801e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:30.395778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-45a5500e-38b2-4b5d-939f-c9ba14c801e1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:30.396926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-45a5500e-38b2-4b5d-939f-c9ba14c801e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:30.436873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c44c1-dab4-4a0d-b97b-79ca33db7202 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:30.437198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c44c1-dab4-4a0d-b97b-79ca33db7202 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:30.437487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c44c1-dab4-4a0d-b97b-79ca33db7202 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:30.438803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:45:30.443969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:30.444261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:30.444537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:30.476867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:30.487061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG passlib.handlers.bcrypt [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81409) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 10 11:45:30.487536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG passlib.handlers.bcrypt [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81409) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 10 11:45:30.537109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:30.538749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:30.635070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:30.744949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5500e-38b2-4b5d-939f-c9ba14c801e1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:30.772356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:30.858921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5500e-38b2-4b5d-939f-c9ba14c801e1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:30.892040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc3cb4-9bec-4c60-bbef-804e106d8889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:30.892607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc3cb4-9bec-4c60-bbef-804e106d8889 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:30.892887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc3cb4-9bec-4c60-bbef-804e106d8889 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:30.893201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc3cb4-9bec-4c60-bbef-804e106d8889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:30.902577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:30.903906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc3cb4-9bec-4c60-bbef-804e106d8889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-aadc3cb4-9bec-4c60-bbef-804e106d8889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:30.912726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:30.913669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:30.914685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:45:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:30.919417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc3cb4-9bec-4c60-bbef-804e106d8889 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:31.002297 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:31.003791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a5c3-8b33-493a-ab33-ca0642353043 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:31.006820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:31.021099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc3cb4-9bec-4c60-bbef-804e106d8889 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:31.041882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ecc0-d789-483f-a40e-44c8f88cb6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:31.042752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ecc0-d789-483f-a40e-44c8f88cb6bb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:31.043039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ecc0-d789-483f-a40e-44c8f88cb6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:31.043322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ecc0-d789-483f-a40e-44c8f88cb6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:31.053756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:31.054353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:31.054631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:31.054908 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:31.055569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:31.055871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:31.057289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:31.069276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:31.074919 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:31.110712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ecc0-d789-483f-a40e-44c8f88cb6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:31.112237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ecc0-d789-483f-a40e-44c8f88cb6bb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:31.170340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a340-23a3-4e62-b89f-dbd022bcc586 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:31.203858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cd341-69c8-404f-8a6e-15456cb4e047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:31.204482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cd341-69c8-404f-8a6e-15456cb4e047 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:31.204764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cd341-69c8-404f-8a6e-15456cb4e047 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:31.205073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cd341-69c8-404f-8a6e-15456cb4e047 None admin] PATH_INFO: `/v3/users/c765c31c0c1d406383a20f8e12957d4e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:31.206207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cd341-69c8-404f-8a6e-15456cb4e047 None admin] RBAC: Authorizing `identity:get_user(user_id=c765c31c0c1d406383a20f8e12957d4e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:31.207658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cd341-69c8-404f-8a6e-15456cb4e047 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:31.208942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:45:31.209230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:31 2022] GET /identity/v3/users/c765c31c0c1d406383a20f8e12957d4e => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:31.214390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cd341-69c8-404f-8a6e-15456cb4e047 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:31.214502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ecc0-d789-483f-a40e-44c8f88cb6bb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:31.217631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:31.229089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:31.313226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ecc0-d789-483f-a40e-44c8f88cb6bb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:31.313727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cd341-69c8-404f-8a6e-15456cb4e047 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:31.347080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f0a0-81b5-4f28-951c-19310a59d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:31.347926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f0a0-81b5-4f28-951c-19310a59d250 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:31.348204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f0a0-81b5-4f28-951c-19310a59d250 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:31.348471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f0a0-81b5-4f28-951c-19310a59d250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:31.348761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:31.349425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:31.349708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:31.349803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f0a0-81b5-4f28-951c-19310a59d250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:31.349986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:31.351206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f0a0-81b5-4f28-951c-19310a59d250 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:31.352746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:31.358588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f0a0-81b5-4f28-951c-19310a59d250 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:31.361025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:31.362507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:45:31.378538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:31.379886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:45:31.380714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:45:31.380714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:45:31.380714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:31.380714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:31.385248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:31.427709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:31.446970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:31.457262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f0a0-81b5-4f28-951c-19310a59d250 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:31.483692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fd523-abb4-4fd4-a9ac-9fd81f08492d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:31.491726 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed31e5-4328-4ec7-a039-a14a596a0c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:31.492334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed31e5-4328-4ec7-a039-a14a596a0c1e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:31.492618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed31e5-4328-4ec7-a039-a14a596a0c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:31.492887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed31e5-4328-4ec7-a039-a14a596a0c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:31.493627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed31e5-4328-4ec7-a039-a14a596a0c1e None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.domain.id=default, user.id=c765c31c0c1d406383a20f8e12957d4e) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:31.493935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed31e5-4328-4ec7-a039-a14a596a0c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:31.495367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed31e5-4328-4ec7-a039-a14a596a0c1e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:31.503416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1322 bytes} [Mon Oct 10 11:45:31 2022] GET /identity/v3/role_assignments?user.id=c765c31c0c1d406383a20f8e12957d4e&scope.domain.id=default&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:31.517313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18448a78-d0c7-4f89-b668-2aae7e0c6099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:31.517953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448a78-d0c7-4f89-b668-2aae7e0c6099 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:31.518237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448a78-d0c7-4f89-b668-2aae7e0c6099 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:31.518512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18448a78-d0c7-4f89-b668-2aae7e0c6099 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:31.519179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18448a78-d0c7-4f89-b668-2aae7e0c6099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:31.519486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18448a78-d0c7-4f89-b668-2aae7e0c6099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:31.520929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18448a78-d0c7-4f89-b668-2aae7e0c6099 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:31.540505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:33.927224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c5db3-d86c-41e8-9f53-ff26d4b6975c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:33.928196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c5db3-d86c-41e8-9f53-ff26d4b6975c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:33.928705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c5db3-d86c-41e8-9f53-ff26d4b6975c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:33.930542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:33.936925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4973c23-fd39-448b-a775-ab80cff00de0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:33.938085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4973c23-fd39-448b-a775-ab80cff00de0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:33.938563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4973c23-fd39-448b-a775-ab80cff00de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:33.970641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a4973c23-fd39-448b-a775-ab80cff00de0 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:33.972225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a4973c23-fd39-448b-a775-ab80cff00de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:34.062707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:34.068045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f840db-9984-47ca-aacf-1380c6cb527b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:34.068554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f840db-9984-47ca-aacf-1380c6cb527b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:34.069059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f840db-9984-47ca-aacf-1380c6cb527b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:34.070552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:34.086244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a7f62-d5f5-4afd-a1b1-0533596e6337 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:34.086792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a7f62-d5f5-4afd-a1b1-0533596e6337 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:34.087284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a7f62-d5f5-4afd-a1b1-0533596e6337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:34.113957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4e2a7f62-d5f5-4afd-a1b1-0533596e6337 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:34.115455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4e2a7f62-d5f5-4afd-a1b1-0533596e6337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:34.175289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff8a9-a555-42db-be62-9fb7196ae102 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:34.175925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff8a9-a555-42db-be62-9fb7196ae102 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:34.176413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ff8a9-a555-42db-be62-9fb7196ae102 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:34.178195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 13/25] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:34.189315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:34.200780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 13/26] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:34.202469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c751f8-8973-4b83-8d59-7acf35e2dc02 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:34.202758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c751f8-8973-4b83-8d59-7acf35e2dc02 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:34.203037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c751f8-8973-4b83-8d59-7acf35e2dc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:34.229980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c9c751f8-8973-4b83-8d59-7acf35e2dc02 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:34.231189 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c9c751f8-8973-4b83-8d59-7acf35e2dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:34.315326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 14/27] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:34.444604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a7f62-d5f5-4afd-a1b1-0533596e6337 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:34.568187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a7f62-d5f5-4afd-a1b1-0533596e6337 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:34.605426 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c751f8-8973-4b83-8d59-7acf35e2dc02 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:34.634948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:34.635602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:34.635942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:34.636226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:34.653405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:34.654892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:45:34.680053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:34.680951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:45:34.681808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:45:34.681808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:45:34.681808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:34.681808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 14/28] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:34.689303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:34.735041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:34.759863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:34.805917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c751f8-8973-4b83-8d59-7acf35e2dc02 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:34.877814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321d891-cee3-46a8-98fd-ddbfb6ccd4c9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:34.888596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32587f-fff8-4411-a28b-e28c9f9ff129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:34.889270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32587f-fff8-4411-a28b-e28c9f9ff129 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:34.889745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32587f-fff8-4411-a28b-e28c9f9ff129 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:34.890170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32587f-fff8-4411-a28b-e28c9f9ff129 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:34.891047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32587f-fff8-4411-a28b-e28c9f9ff129 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:34.892705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32587f-fff8-4411-a28b-e28c9f9ff129 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:34.941553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:34.942176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:34.944422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:34.944781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:34.945490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:34.945803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:34.947866 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:34.977370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 15/29] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:34.978210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:35.081469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 15/30] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 10 11:45:34 2022] POST /identity/v3/roles => generated 219 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:45:35.083141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32587f-fff8-4411-a28b-e28c9f9ff129 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:35.092922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:35.100272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2758-0077-4ff7-90de-e79b51680ca4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:35.142023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e119c-56b0-4b9c-a2b2-cbec76a4ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:35.143023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e119c-56b0-4b9c-a2b2-cbec76a4ff6e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.143513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e119c-56b0-4b9c-a2b2-cbec76a4ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.143976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e119c-56b0-4b9c-a2b2-cbec76a4ff6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.156270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e119c-56b0-4b9c-a2b2-cbec76a4ff6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e10e119c-56b0-4b9c-a2b2-cbec76a4ff6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:35.162444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:35.163338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:35.164098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:35.167074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 16/31] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:35.168700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc567c-76ff-422e-81a2-c41cb76f45d1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.169285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc567c-76ff-422e-81a2-c41cb76f45d1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.169730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc567c-76ff-422e-81a2-c41cb76f45d1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.171119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 17/32] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:35.173182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc567c-76ff-422e-81a2-c41cb76f45d1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:35.207916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32587f-fff8-4411-a28b-e28c9f9ff129 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:35.237701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:35.250583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beb3a9-0522-4cf3-8d2e-750ba793f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:35.251531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beb3a9-0522-4cf3-8d2e-750ba793f8e6 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.251977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beb3a9-0522-4cf3-8d2e-750ba793f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.252438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beb3a9-0522-4cf3-8d2e-750ba793f8e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.254159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beb3a9-0522-4cf3-8d2e-750ba793f8e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:35.256101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beb3a9-0522-4cf3-8d2e-750ba793f8e6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:35.298082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 16/33] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:45:35 2022] POST /identity/v3/projects => generated 301 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:45:35.299981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a26456-3c0f-4b27-82b2-e257bb8db635 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.300460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a26456-3c0f-4b27-82b2-e257bb8db635 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.300905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a26456-3c0f-4b27-82b2-e257bb8db635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.319357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc567c-76ff-422e-81a2-c41cb76f45d1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:35.324388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d9a26456-3c0f-4b27-82b2-e257bb8db635 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:35.327569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d9a26456-3c0f-4b27-82b2-e257bb8db635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:35.406333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:35.406924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.407202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.407472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.410707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:35.411024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:35.412497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:35.430897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 17/34] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:35.435328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 18/35] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:35.441750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a26456-3c0f-4b27-82b2-e257bb8db635 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:35.561551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a26456-3c0f-4b27-82b2-e257bb8db635 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:35.577397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:35.598657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13891cd-1d5c-4a77-b477-387d1627f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:35.599731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13891cd-1d5c-4a77-b477-387d1627f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.600210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13891cd-1d5c-4a77-b477-387d1627f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.600724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13891cd-1d5c-4a77-b477-387d1627f4a3 None admin] PATH_INFO: `/v3/users/c765c31c0c1d406383a20f8e12957d4e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.602395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13891cd-1d5c-4a77-b477-387d1627f4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=c765c31c0c1d406383a20f8e12957d4e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:35.604111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13891cd-1d5c-4a77-b477-387d1627f4a3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:35.605921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 18/36] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:35 2022] GET /identity/v3/users/c765c31c0c1d406383a20f8e12957d4e => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:35.612620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:35.638410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:35.732912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098642c-44b9-4278-bd2c-cf161027a072 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:35.770265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49328-53e4-4766-94ef-57fd242f8bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:35.771258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49328-53e4-4766-94ef-57fd242f8bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.771752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49328-53e4-4766-94ef-57fd242f8bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.772333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b49328-53e4-4766-94ef-57fd242f8bb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.773726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b49328-53e4-4766-94ef-57fd242f8bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:35.775391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b49328-53e4-4766-94ef-57fd242f8bb2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:35.777575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 19/37] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:35.784512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13891cd-1d5c-4a77-b477-387d1627f4a3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:35.791612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49328-53e4-4766-94ef-57fd242f8bb2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:35.885487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:35.904757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b49328-53e4-4766-94ef-57fd242f8bb2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:35.919016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13891cd-1d5c-4a77-b477-387d1627f4a3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:35.940748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c9089-f447-4663-863c-3d48e3e89bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:35.941408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c9089-f447-4663-863c-3d48e3e89bd9 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.941691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c9089-f447-4663-863c-3d48e3e89bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.942202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c9089-f447-4663-863c-3d48e3e89bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.942629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c9089-f447-4663-863c-3d48e3e89bd9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:35.944022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c9089-f447-4663-863c-3d48e3e89bd9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:35.957591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c881c-d84b-4302-b767-aa101b5210c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:35.958264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c881c-d84b-4302-b767-aa101b5210c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.958598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c881c-d84b-4302-b767-aa101b5210c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.958846 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c881c-d84b-4302-b767-aa101b5210c6 None admin] PATH_INFO: `/v3/domains/default/users/c765c31c0c1d406383a20f8e12957d4e/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.960824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c881c-d84b-4302-b767-aa101b5210c6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c765c31c0c1d406383a20f8e12957d4e, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:35.962313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c881c-d84b-4302-b767-aa101b5210c6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:35.977421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 19/38] 10.222.0.45 () {58 vars in 1361 bytes} [Mon Oct 10 11:45:35 2022] PUT /identity/v3/domains/default/users/c765c31c0c1d406383a20f8e12957d4e/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:45:35.979024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56899-4aa9-4e05-9337-550f2732045e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.979523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56899-4aa9-4e05-9337-550f2732045e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.979993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf56899-4aa9-4e05-9337-550f2732045e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:35.981566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 20/39] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:35.991431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c390a-fb2d-442a-8b67-9f10879f0102 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:35.992079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c390a-fb2d-442a-8b67-9f10879f0102 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:35.992553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c390a-fb2d-442a-8b67-9f10879f0102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:36.013022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e87c390a-fb2d-442a-8b67-9f10879f0102 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:36.014492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e87c390a-fb2d-442a-8b67-9f10879f0102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:36.048821 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:36.095677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 21/40] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:36.097308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edaf3-7b82-4014-b7f7-cc145133f7c0 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:36.097701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edaf3-7b82-4014-b7f7-cc145133f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:36.098097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93edaf3-7b82-4014-b7f7-cc145133f7c0 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:36.099878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 22/41] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:36.105791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee23c1-d2ec-463f-85fc-b36d120796e7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:36.106183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee23c1-d2ec-463f-85fc-b36d120796e7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:36.106562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee23c1-d2ec-463f-85fc-b36d120796e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:36.127981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ebee23c1-d2ec-463f-85fc-b36d120796e7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:36.129458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ebee23c1-d2ec-463f-85fc-b36d120796e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:36.174740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 20/42] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 10 11:45:35 2022] POST /identity/v3/roles => generated 225 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:45:36.217129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 23/43] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:36.386051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c9089-f447-4663-863c-3d48e3e89bd9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:36.491552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee23c1-d2ec-463f-85fc-b36d120796e7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:36.492747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c9089-f447-4663-863c-3d48e3e89bd9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:36.528303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3246632-f829-43c6-84e4-6569b3c9813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:36.529074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3246632-f829-43c6-84e4-6569b3c9813f None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:36.529363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3246632-f829-43c6-84e4-6569b3c9813f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:36.529640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3246632-f829-43c6-84e4-6569b3c9813f None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:36.530322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3246632-f829-43c6-84e4-6569b3c9813f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:36.532436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3246632-f829-43c6-84e4-6569b3c9813f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:36.553053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 21/44] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 10 11:45:36 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:45:36.605492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:36.612567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee23c1-d2ec-463f-85fc-b36d120796e7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:36.650575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79224c1-b42a-45cf-b9d5-903b9db070ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:36.651158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79224c1-b42a-45cf-b9d5-903b9db070ab None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:36.651457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79224c1-b42a-45cf-b9d5-903b9db070ab None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:36.651742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79224c1-b42a-45cf-b9d5-903b9db070ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:36.652881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79224c1-b42a-45cf-b9d5-903b9db070ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:36.654417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79224c1-b42a-45cf-b9d5-903b9db070ab None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:36.656157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 24/45] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:36.661991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3246632-f829-43c6-84e4-6569b3c9813f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:36.671472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:36.776808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3246632-f829-43c6-84e4-6569b3c9813f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:36.810815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a87136-1787-4fec-a8cf-5e5b84f42276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:36.811466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87136-1787-4fec-a8cf-5e5b84f42276 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:36.811753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87136-1787-4fec-a8cf-5e5b84f42276 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:36.812031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a87136-1787-4fec-a8cf-5e5b84f42276 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:36.813613 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a87136-1787-4fec-a8cf-5e5b84f42276 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:36.814790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a87136-1787-4fec-a8cf-5e5b84f42276 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:36.843470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 22/46] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:45:36 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:45:38.174361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae07f-a887-4427-8a0c-c402e97e9e81 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:38.174842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae07f-a887-4427-8a0c-c402e97e9e81 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:38.174842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae07f-a887-4427-8a0c-c402e97e9e81 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:38.176146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 25/47] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:38.181551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e224-59ae-4dd6-a48a-ac6aafe9d8a2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:38.181956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e224-59ae-4dd6-a48a-ac6aafe9d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:38.182235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e224-59ae-4dd6-a48a-ac6aafe9d8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:38.200289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9668e224-59ae-4dd6-a48a-ac6aafe9d8a2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:38.201822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9668e224-59ae-4dd6-a48a-ac6aafe9d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:38.253140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:38.267228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:38.534900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae07f-a887-4427-8a0c-c402e97e9e81 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:38.632759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae07f-a887-4427-8a0c-c402e97e9e81 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:38.665767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69d33-ecdb-4f6f-9587-1b922c4fc254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:38.666387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69d33-ecdb-4f6f-9587-1b922c4fc254 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:38.666666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69d33-ecdb-4f6f-9587-1b922c4fc254 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:38.666941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf69d33-ecdb-4f6f-9587-1b922c4fc254 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:38.678056 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf69d33-ecdb-4f6f-9587-1b922c4fc254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-fdf69d33-ecdb-4f6f-9587-1b922c4fc254 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:38.686668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:38.687646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:45:38.688592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 26/49] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:38.695266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668e224-59ae-4dd6-a48a-ac6aafe9d8a2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:38.795671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668e224-59ae-4dd6-a48a-ac6aafe9d8a2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:38.831088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071d604-e747-4737-bf24-21d3c76cf0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:38.831700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d604-e747-4737-bf24-21d3c76cf0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:38.831985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d604-e747-4737-bf24-21d3c76cf0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:38.832264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071d604-e747-4737-bf24-21d3c76cf0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:38.832932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071d604-e747-4737-bf24-21d3c76cf0c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:38.833273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071d604-e747-4737-bf24-21d3c76cf0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:38.834686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071d604-e747-4737-bf24-21d3c76cf0c5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:38.842751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 24/50] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:38.849687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69d33-ecdb-4f6f-9587-1b922c4fc254 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:38.878278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:38.949931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf69d33-ecdb-4f6f-9587-1b922c4fc254 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:38.973522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e15bf2-d630-41c6-908c-9272c5427e06 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:38.973819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e15bf2-d630-41c6-908c-9272c5427e06 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:38.974103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e15bf2-d630-41c6-908c-9272c5427e06 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:38.975570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 25/51] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:38.980165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acedd-903b-4eac-930b-2ef1ab56d892 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:38.980457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acedd-903b-4eac-930b-2ef1ab56d892 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:38.980740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acedd-903b-4eac-930b-2ef1ab56d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:38.983666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfe783-91fd-4e71-ad28-b4a9b49544b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:38.984307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe783-91fd-4e71-ad28-b4a9b49544b3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:38.984592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe783-91fd-4e71-ad28-b4a9b49544b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:38.984869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfe783-91fd-4e71-ad28-b4a9b49544b3 None admin] PATH_INFO: `/v3/users/c765c31c0c1d406383a20f8e12957d4e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:38.986031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfe783-91fd-4e71-ad28-b4a9b49544b3 None admin] RBAC: Authorizing `identity:get_user(user_id=c765c31c0c1d406383a20f8e12957d4e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:38.987481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfe783-91fd-4e71-ad28-b4a9b49544b3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:38.989073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 27/52] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:38 2022] GET /identity/v3/users/c765c31c0c1d406383a20f8e12957d4e => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:38.994362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfe783-91fd-4e71-ad28-b4a9b49544b3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:38.999427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-198acedd-903b-4eac-930b-2ef1ab56d892 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:39.001195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-198acedd-903b-4eac-930b-2ef1ab56d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:39.046413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:39.066671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 26/53] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:39.084851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:39.093488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfe783-91fd-4e71-ad28-b4a9b49544b3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:39.127223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedac53-1b78-47ab-b886-c3d5456105a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:39.127841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedac53-1b78-47ab-b886-c3d5456105a0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:39.128123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedac53-1b78-47ab-b886-c3d5456105a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:39.128399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedac53-1b78-47ab-b886-c3d5456105a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:39.129543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedac53-1b78-47ab-b886-c3d5456105a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:39.130981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedac53-1b78-47ab-b886-c3d5456105a0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:39.132506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 28/54] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:39.138225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198acedd-903b-4eac-930b-2ef1ab56d892 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:39.233606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198acedd-903b-4eac-930b-2ef1ab56d892 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:39.265820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:39.266934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:39.267212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:39.267484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:39.268197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.domain.id=default, user.id=c765c31c0c1d406383a20f8e12957d4e) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:39.268502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:39.269963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:39.276813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1322 bytes} [Mon Oct 10 11:45:39 2022] GET /identity/v3/role_assignments?user.id=c765c31c0c1d406383a20f8e12957d4e&scope.domain.id=default&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:39.334719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedac53-1b78-47ab-b886-c3d5456105a0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:39.542278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedac53-1b78-47ab-b886-c3d5456105a0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:39.575059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394e776-d58c-4fab-b560-c68be2eb788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:39.575683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394e776-d58c-4fab-b560-c68be2eb788f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:39.575969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394e776-d58c-4fab-b560-c68be2eb788f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:39.576245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394e776-d58c-4fab-b560-c68be2eb788f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:39.577361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394e776-d58c-4fab-b560-c68be2eb788f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:39.578850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394e776-d58c-4fab-b560-c68be2eb788f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:39.580390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 29/56] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:39.586057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:39.630654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:39.682635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0caf0-9c87-42c8-9c26-7e397fd7e660 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:39.714008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffc35c-3ed0-4390-8a51-deeedb2105e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:39.714601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc35c-3ed0-4390-8a51-deeedb2105e3 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:39.714881 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc35c-3ed0-4390-8a51-deeedb2105e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:39.715152 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffc35c-3ed0-4390-8a51-deeedb2105e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:39.715802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffc35c-3ed0-4390-8a51-deeedb2105e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:39.717280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffc35c-3ed0-4390-8a51-deeedb2105e3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:39.742959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 28/57] 10.222.0.45 () {60 vars in 1140 bytes} [Mon Oct 10 11:45:39 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:45:41.882409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6f45-80ae-4699-a7e7-84bff9f0d76f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:41.882845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6f45-80ae-4699-a7e7-84bff9f0d76f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:41.882968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6f45-80ae-4699-a7e7-84bff9f0d76f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:41.884311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 30/58] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:41.889439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf02ae9-fe80-4a7f-bf44-0b77dafd7776 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:41.889866 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf02ae9-fe80-4a7f-bf44-0b77dafd7776 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:41.889991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf02ae9-fe80-4a7f-bf44-0b77dafd7776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:41.908228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3cf02ae9-fe80-4a7f-bf44-0b77dafd7776 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:41.909431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3cf02ae9-fe80-4a7f-bf44-0b77dafd7776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:41.972229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 29/59] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:42.242447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f6f45-80ae-4699-a7e7-84bff9f0d76f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:42.270807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:42.341596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f6f45-80ae-4699-a7e7-84bff9f0d76f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:42.374164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e41864-869a-4431-a39c-7f70870e8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:42.374784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41864-869a-4431-a39c-7f70870e8032 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:42.375068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41864-869a-4431-a39c-7f70870e8032 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:42.375341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e41864-869a-4431-a39c-7f70870e8032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:42.377064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41864-869a-4431-a39c-7f70870e8032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:42.378498 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e41864-869a-4431-a39c-7f70870e8032 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:42.380023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 31/60] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:42.385396 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf02ae9-fe80-4a7f-bf44-0b77dafd7776 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:42.410857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:42.482347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf02ae9-fe80-4a7f-bf44-0b77dafd7776 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:42.516051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9676f-b07d-471e-b3d6-14cdb8ea8d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:42.516636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9676f-b07d-471e-b3d6-14cdb8ea8d89 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:42.516917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9676f-b07d-471e-b3d6-14cdb8ea8d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:42.517220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9676f-b07d-471e-b3d6-14cdb8ea8d89 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:42.517863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9676f-b07d-471e-b3d6-14cdb8ea8d89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:42.519311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9676f-b07d-471e-b3d6-14cdb8ea8d89 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:42.544927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 30/61] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:45:42 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:45:45.687553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e7b2-d4cf-4e61-af8d-5e5111c0dffc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:45.689084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e7b2-d4cf-4e61-af8d-5e5111c0dffc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:45.689560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e7b2-d4cf-4e61-af8d-5e5111c0dffc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:45.691153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 32/62] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:45.696426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4d1c-b8fc-4c10-853b-ea387517daff None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:45.697268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4d1c-b8fc-4c10-853b-ea387517daff None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:45.697745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4d1c-b8fc-4c10-853b-ea387517daff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:45.721043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-372f4d1c-b8fc-4c10-853b-ea387517daff None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:45.722561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-372f4d1c-b8fc-4c10-853b-ea387517daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:45.811276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 31/63] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:46.023242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb26db-cf75-4aef-a3a8-4a4eceb55337 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.023905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb26db-cf75-4aef-a3a8-4a4eceb55337 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.024390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb26db-cf75-4aef-a3a8-4a4eceb55337 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.025991 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 33/64] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:46.038469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371492-b42d-4125-9f7b-fd108408cbfa None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.039046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371492-b42d-4125-9f7b-fd108408cbfa None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.039521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c371492-b42d-4125-9f7b-fd108408cbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.064690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6c371492-b42d-4125-9f7b-fd108408cbfa None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:46.066220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6c371492-b42d-4125-9f7b-fd108408cbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:46.074472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:46.092405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b459-2800-45ae-b258-d4cfc8a40f98 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.092405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b459-2800-45ae-b258-d4cfc8a40f98 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.092657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88b459-2800-45ae-b258-d4cfc8a40f98 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.094365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 34/65] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:46.099116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2efb9-9ee4-4d55-a61e-e4358d0eefe8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.099406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2efb9-9ee4-4d55-a61e-e4358d0eefe8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.099713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2efb9-9ee4-4d55-a61e-e4358d0eefe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.121845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c8a2efb9-9ee4-4d55-a61e-e4358d0eefe8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:46.123501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c8a2efb9-9ee4-4d55-a61e-e4358d0eefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:46.181774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 32/66] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:46.206040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371492-b42d-4125-9f7b-fd108408cbfa None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:46.228088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 35/67] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:46.337976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c371492-b42d-4125-9f7b-fd108408cbfa None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:46.388753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354d510-bfb0-4032-8689-8b25948a0c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:46.389433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d510-bfb0-4032-8689-8b25948a0c21 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.389712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d510-bfb0-4032-8689-8b25948a0c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.389984 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d510-bfb0-4032-8689-8b25948a0c21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.409893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354d510-bfb0-4032-8689-8b25948a0c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7354d510-bfb0-4032-8689-8b25948a0c21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:46.414837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:46.415723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:46.416521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 33/68] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:46.423855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2efb9-9ee4-4d55-a61e-e4358d0eefe8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:46.452453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:46.491577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b4fd-2a4e-4a4e-8851-e5fd68dc0dfb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.491877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b4fd-2a4e-4a4e-8851-e5fd68dc0dfb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.492152 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b4fd-2a4e-4a4e-8851-e5fd68dc0dfb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.493635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 34/69] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:45:46.499172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98418106-415c-41e0-9bbd-2753945f5a8c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.499463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98418106-415c-41e0-9bbd-2753945f5a8c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.499740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98418106-415c-41e0-9bbd-2753945f5a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.507151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:46.520542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-98418106-415c-41e0-9bbd-2753945f5a8c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:46.521758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-98418106-415c-41e0-9bbd-2753945f5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:46.548671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2efb9-9ee4-4d55-a61e-e4358d0eefe8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:46.583055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:46.583669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.583953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.584229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.584891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:46.585230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:46.586606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:46.590901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 35/70] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:46.592080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9b92-aeeb-4608-be88-03ce59d5e0e6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.592370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9b92-aeeb-4608-be88-03ce59d5e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.592647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b9b92-aeeb-4608-be88-03ce59d5e0e6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.594055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 36/71] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:46.594588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b9b92-aeeb-4608-be88-03ce59d5e0e6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:46.606329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 36/72] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:45:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:46.606329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:46.700263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:46.705814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b9b92-aeeb-4608-be88-03ce59d5e0e6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:46.714514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b793-f163-4667-8dca-1ed4c28ecdc7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:46.738626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:46.744942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c811ee9-f8fe-4c0e-9191-00812eb3ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:46.745913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c811ee9-f8fe-4c0e-9191-00812eb3ca72 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.746355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c811ee9-f8fe-4c0e-9191-00812eb3ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.746689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c811ee9-f8fe-4c0e-9191-00812eb3ca72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.750772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf571f-ee4c-4103-bdab-b97336313689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:46.751608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf571f-ee4c-4103-bdab-b97336313689 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.752051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf571f-ee4c-4103-bdab-b97336313689 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.752473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf571f-ee4c-4103-bdab-b97336313689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.757368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c811ee9-f8fe-4c0e-9191-00812eb3ca72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1c811ee9-f8fe-4c0e-9191-00812eb3ca72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:46.762136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:46.763195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:46.764075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:45:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:46.764735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a2902-8892-4cb5-8c15-26e6d922fab2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.764990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a2902-8892-4cb5-8c15-26e6d922fab2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.765270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a2902-8892-4cb5-8c15-26e6d922fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.769751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf571f-ee4c-4103-bdab-b97336313689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-67bf571f-ee4c-4103-bdab-b97336313689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:46.774604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:46.775463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:45:46.776232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 37/74] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:46.777521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf571f-ee4c-4103-bdab-b97336313689 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:46.796312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ee3a2902-8892-4cb5-8c15-26e6d922fab2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:46.797915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ee3a2902-8892-4cb5-8c15-26e6d922fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:46.877110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 38/75] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:46.877110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a2902-8892-4cb5-8c15-26e6d922fab2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:46.890964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf571f-ee4c-4103-bdab-b97336313689 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:46.928304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e22e4d-da05-4fe9-8546-6c3238e3f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:46.929143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22e4d-da05-4fe9-8546-6c3238e3f357 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:46.929724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22e4d-da05-4fe9-8546-6c3238e3f357 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:46.930008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e22e4d-da05-4fe9-8546-6c3238e3f357 None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:46.946490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e22e4d-da05-4fe9-8546-6c3238e3f357 None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:46.948118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e22e4d-da05-4fe9-8546-6c3238e3f357 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:46.950144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 38/76] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:46 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:46.950909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e22e4d-da05-4fe9-8546-6c3238e3f357 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:46.961904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:46.974214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a2902-8892-4cb5-8c15-26e6d922fab2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:46.997495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.010332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.010996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.011227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.011501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.012166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:47.012471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.013882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.022989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 39/77] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:45:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:47.027778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.064151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e22e4d-da05-4fe9-8546-6c3238e3f357 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.100401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.101102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.101387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.101660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.102430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:47.102736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.104214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.113280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 39/78] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:47.113950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.131512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ddaa6-cd3d-4d4d-9a1d-9ea1017ce1e4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.165847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625e996-c3ad-4d44-8fbb-528a0d73d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.166542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625e996-c3ad-4d44-8fbb-528a0d73d2bf None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.166827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625e996-c3ad-4d44-8fbb-528a0d73d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.167108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625e996-c3ad-4d44-8fbb-528a0d73d2bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.177054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625e996-c3ad-4d44-8fbb-528a0d73d2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4625e996-c3ad-4d44-8fbb-528a0d73d2bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:47.181867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:47.182835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:47.184087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:47.185369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.185438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 40/79] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:47.185438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625e996-c3ad-4d44-8fbb-528a0d73d2bf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.219464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df2540-0a79-4028-a1a0-a3902ab477e1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.229455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.253983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2300d8-a12e-408e-9345-11ccbbabc227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.255341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2300d8-a12e-408e-9345-11ccbbabc227 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.255635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2300d8-a12e-408e-9345-11ccbbabc227 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.255917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2300d8-a12e-408e-9345-11ccbbabc227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.283613 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625e996-c3ad-4d44-8fbb-528a0d73d2bf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.316510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d890530-f6cc-48ed-8407-5adbeb7bca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.317169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d890530-f6cc-48ed-8407-5adbeb7bca00 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.317449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d890530-f6cc-48ed-8407-5adbeb7bca00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.317720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d890530-f6cc-48ed-8407-5adbeb7bca00 None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.318859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d890530-f6cc-48ed-8407-5adbeb7bca00 None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.320314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d890530-f6cc-48ed-8407-5adbeb7bca00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.321960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 41/80] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:47.322499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2300d8-a12e-408e-9345-11ccbbabc227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.322717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d890530-f6cc-48ed-8407-5adbeb7bca00 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.323962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2300d8-a12e-408e-9345-11ccbbabc227 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.387157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.419074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d890530-f6cc-48ed-8407-5adbeb7bca00 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.420801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 40/81] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:47.421720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2300d8-a12e-408e-9345-11ccbbabc227 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.437611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.459061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb9f2-e488-4f5b-9dc2-4af2aed4e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.459693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb9f2-e488-4f5b-9dc2-4af2aed4e70b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.460265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb9f2-e488-4f5b-9dc2-4af2aed4e70b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.460546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb9f2-e488-4f5b-9dc2-4af2aed4e70b None admin] PATH_INFO: `/v3/users/c765c31c0c1d406383a20f8e12957d4e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.461687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb9f2-e488-4f5b-9dc2-4af2aed4e70b None admin] RBAC: Authorizing `identity:get_user(user_id=c765c31c0c1d406383a20f8e12957d4e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.463138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb9f2-e488-4f5b-9dc2-4af2aed4e70b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.464678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 42/82] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/users/c765c31c0c1d406383a20f8e12957d4e => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:47.465459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb9f2-e488-4f5b-9dc2-4af2aed4e70b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.518584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2300d8-a12e-408e-9345-11ccbbabc227 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.551478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acb421-ef8f-4de4-96a1-9ce8fd3f3c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.552109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acb421-ef8f-4de4-96a1-9ce8fd3f3c59 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.552396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acb421-ef8f-4de4-96a1-9ce8fd3f3c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.552682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86acb421-ef8f-4de4-96a1-9ce8fd3f3c59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.553835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acb421-ef8f-4de4-96a1-9ce8fd3f3c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.555273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86acb421-ef8f-4de4-96a1-9ce8fd3f3c59 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.556833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 41/83] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:47.560995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb9f2-e488-4f5b-9dc2-4af2aed4e70b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.562227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acb421-ef8f-4de4-96a1-9ce8fd3f3c59 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.595618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.596233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.596519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.596796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.597489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:47.597769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.597856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.599163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.607189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 43/84] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:47.607979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.649954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.662430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86acb421-ef8f-4de4-96a1-9ce8fd3f3c59 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.696482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b603-51b0-4446-9051-8043cbde5c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.697121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b603-51b0-4446-9051-8043cbde5c97 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.697416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b603-51b0-4446-9051-8043cbde5c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.697690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b603-51b0-4446-9051-8043cbde5c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.706835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f0543-5aa7-43ca-97cd-5af62b4906a3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.739275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3ac73-56aa-4769-9acb-6daa6b79410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.740113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ac73-56aa-4769-9acb-6daa6b79410f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.740402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ac73-56aa-4769-9acb-6daa6b79410f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.740684 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3ac73-56aa-4769-9acb-6daa6b79410f None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.741858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3ac73-56aa-4769-9acb-6daa6b79410f None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.743309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3ac73-56aa-4769-9acb-6daa6b79410f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.744922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 44/85] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:47.745718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3ac73-56aa-4769-9acb-6daa6b79410f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.764485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986b603-51b0-4446-9051-8043cbde5c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.765993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986b603-51b0-4446-9051-8043cbde5c97 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.800513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.845834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3ac73-56aa-4769-9acb-6daa6b79410f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:47.855630 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:47.866960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 42/86] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:47.867951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b603-51b0-4446-9051-8043cbde5c97 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:47.879559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44eb79-c064-4f27-86d7-44246b04cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:47.880176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44eb79-c064-4f27-86d7-44246b04cee2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:47.880462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44eb79-c064-4f27-86d7-44246b04cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:47.880739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44eb79-c064-4f27-86d7-44246b04cee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:47.946461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44eb79-c064-4f27-86d7-44246b04cee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:47.948113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44eb79-c064-4f27-86d7-44246b04cee2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:47.967304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b603-51b0-4446-9051-8043cbde5c97 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:48.000299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0cb3-2aa0-4a9e-a4a3-495053b04192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:48.000920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0cb3-2aa0-4a9e-a4a3-495053b04192 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:48.001772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0cb3-2aa0-4a9e-a4a3-495053b04192 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:48.002059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0cb3-2aa0-4a9e-a4a3-495053b04192 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:48.002744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0cb3-2aa0-4a9e-a4a3-495053b04192 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:48.004198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0cb3-2aa0-4a9e-a4a3-495053b04192 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:48.016361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:48.032173 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 43/87] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:45:47 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:45:48.045250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0cb3-2aa0-4a9e-a4a3-495053b04192 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:48.073657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 45/88] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:48.074691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44eb79-c064-4f27-86d7-44246b04cee2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:48.090230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:48.152126 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0cb3-2aa0-4a9e-a4a3-495053b04192 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:48.187710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44eb79-c064-4f27-86d7-44246b04cee2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:48.193864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64589c10-0a54-480d-8876-a313c4b523f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:48.194524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64589c10-0a54-480d-8876-a313c4b523f6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:48.194809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64589c10-0a54-480d-8876-a313c4b523f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:48.195084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64589c10-0a54-480d-8876-a313c4b523f6 None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:48.196600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64589c10-0a54-480d-8876-a313c4b523f6 None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:48.197757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64589c10-0a54-480d-8876-a313c4b523f6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:48.199504 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 44/89] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:48 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:48.201843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64589c10-0a54-480d-8876-a313c4b523f6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:48.232462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:48.233123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:48.233415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:48.233694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:48.234430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] RBAC: Adding query filter params (role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=0229e1f6c84e43d0ab052db94ab62329, user.id=f259ec9489364c74a1ba8b68ff8cdbb4) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:48.234742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:48.236239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:48.242102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 46/90] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:45:48 2022] GET /identity/v3/role_assignments?user.id=f259ec9489364c74a1ba8b68ff8cdbb4&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=51dbfe81239845968f102b6b956c7061 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:48.245951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:48.276143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:48.330408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64589c10-0a54-480d-8876-a313c4b523f6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:48.369918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:48.382603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41755d45-ed7e-4e15-b85b-d9573e7903b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:48.383750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755d45-ed7e-4e15-b85b-d9573e7903b8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:48.383750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755d45-ed7e-4e15-b85b-d9573e7903b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:48.383908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755d45-ed7e-4e15-b85b-d9573e7903b8 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:48.385900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41755d45-ed7e-4e15-b85b-d9573e7903b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:48.387435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41755d45-ed7e-4e15-b85b-d9573e7903b8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:48.389683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 45/91] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:48 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:48.390222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41755d45-ed7e-4e15-b85b-d9573e7903b8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:48.411054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6126d-5cef-499c-916e-209932a7ec21 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:48.454676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a6c2-43de-4fda-b8fe-543574dcdb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:48.455256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a6c2-43de-4fda-b8fe-543574dcdb35 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:48.455552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a6c2-43de-4fda-b8fe-543574dcdb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:48.455822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a6c2-43de-4fda-b8fe-543574dcdb35 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:48.457903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7a6c2-43de-4fda-b8fe-543574dcdb35 None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:48.459374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7a6c2-43de-4fda-b8fe-543574dcdb35 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:48.462331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 47/92] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:48 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:48.463127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a6c2-43de-4fda-b8fe-543574dcdb35 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:48.518818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41755d45-ed7e-4e15-b85b-d9573e7903b8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:48.554381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:48.565607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571e72b-13a6-4ec1-aefb-5422e0347af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:48.566231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e72b-13a6-4ec1-aefb-5422e0347af6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:48.566518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e72b-13a6-4ec1-aefb-5422e0347af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:48.566794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571e72b-13a6-4ec1-aefb-5422e0347af6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:48.580917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a6c2-43de-4fda-b8fe-543574dcdb35 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:48.616796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:48.617494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:48.617882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:48.618165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:48.618898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] RBAC: Adding query filter params (role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=0229e1f6c84e43d0ab052db94ab62329, user.id=f259ec9489364c74a1ba8b68ff8cdbb4) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:48.619213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:48.620777 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:48.627535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 48/93] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:45:48 2022] GET /identity/v3/role_assignments?user.id=f259ec9489364c74a1ba8b68ff8cdbb4&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:48.628448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:48.639060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:48.650660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571e72b-13a6-4ec1-aefb-5422e0347af6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:48.652761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571e72b-13a6-4ec1-aefb-5422e0347af6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:48.875615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f3bb7-d344-4cdb-a025-2479a063c5e9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:48.883968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 46/94] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:48.892888 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571e72b-13a6-4ec1-aefb-5422e0347af6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:48.939972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:48.940598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:48.940886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:48.941190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:48.941929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=0229e1f6c84e43d0ab052db94ab62329, user.id=c765c31c0c1d406383a20f8e12957d4e) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:48.942361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:48.943387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:48.944679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:48.960487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 49/95] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:45:48 2022] GET /identity/v3/role_assignments?user.id=c765c31c0c1d406383a20f8e12957d4e&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:49.022393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571e72b-13a6-4ec1-aefb-5422e0347af6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:49.058660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e7a83-8a75-4c13-b963-5350096b79e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:49.059636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7a83-8a75-4c13-b963-5350096b79e8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:49.060062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7a83-8a75-4c13-b963-5350096b79e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:49.060479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7a83-8a75-4c13-b963-5350096b79e8 None admin] PATH_INFO: `/v3/projects/2ccb98feecd34c67a6acb4db9d5c724e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:49.061849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e7a83-8a75-4c13-b963-5350096b79e8 None admin] RBAC: Authorizing `identity:get_project(project_id=2ccb98feecd34c67a6acb4db9d5c724e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:49.063459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e7a83-8a75-4c13-b963-5350096b79e8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:49.068891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 47/96] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:48 2022] GET /identity/v3/projects/2ccb98feecd34c67a6acb4db9d5c724e => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:49.072358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:49.151426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:49.190801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f8c25-708d-4327-983f-4184c3308164 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:49.231004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e646832-a2f1-4ad9-be16-b405e5e594fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:49.231981 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646832-a2f1-4ad9-be16-b405e5e594fb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:49.232409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646832-a2f1-4ad9-be16-b405e5e594fb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:49.232827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e646832-a2f1-4ad9-be16-b405e5e594fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:49.233809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646832-a2f1-4ad9-be16-b405e5e594fb None admin] RBAC: Adding query filter params (role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=2ccb98feecd34c67a6acb4db9d5c724e, user.id=f259ec9489364c74a1ba8b68ff8cdbb4) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:49.234264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646832-a2f1-4ad9-be16-b405e5e594fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:49.236463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e646832-a2f1-4ad9-be16-b405e5e594fb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:49.248531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 50/97] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:45:49 2022] GET /identity/v3/role_assignments?user.id=f259ec9489364c74a1ba8b68ff8cdbb4&scope.project.id=2ccb98feecd34c67a6acb4db9d5c724e&role.id=51dbfe81239845968f102b6b956c7061 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:51.037907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddad86-c572-4ed5-a22a-cefff20e8727 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:51.038437 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddad86-c572-4ed5-a22a-cefff20e8727 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:51.038437 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddad86-c572-4ed5-a22a-cefff20e8727 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:51.039792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 48/98] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:51.045176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961eb65-0d50-4ad8-b83a-df407ea2b640 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:51.045552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961eb65-0d50-4ad8-b83a-df407ea2b640 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:51.045732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961eb65-0d50-4ad8-b83a-df407ea2b640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:51.070286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3961eb65-0d50-4ad8-b83a-df407ea2b640 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:51.071421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3961eb65-0d50-4ad8-b83a-df407ea2b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:51.108445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84a0f-2c1e-4e14-8732-954b85e73e32 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:51.108736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84a0f-2c1e-4e14-8732-954b85e73e32 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:51.109033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84a0f-2c1e-4e14-8732-954b85e73e32 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:51.110534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 49/99] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:45:51.116397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2342f9-19ab-46ae-a094-f0e40c5dcd01 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:51.116689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2342f9-19ab-46ae-a094-f0e40c5dcd01 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:51.116986 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2342f9-19ab-46ae-a094-f0e40c5dcd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:51.150291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8d2342f9-19ab-46ae-a094-f0e40c5dcd01 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:51.152790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8d2342f9-19ab-46ae-a094-f0e40c5dcd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:51.185369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 51/100] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:51.246050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 50/101] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:51.441139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c23f1-1bcf-4b57-b686-09ea593bb35e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:51.441452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c23f1-1bcf-4b57-b686-09ea593bb35e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:51.441641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c23f1-1bcf-4b57-b686-09ea593bb35e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:51.443198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 52/102] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:51.448729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad61a-7047-4c01-9e09-70223b0e7667 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:51.449053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad61a-7047-4c01-9e09-70223b0e7667 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:51.449337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad61a-7047-4c01-9e09-70223b0e7667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:51.496938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-96cad61a-7047-4c01-9e09-70223b0e7667 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:51.498199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-96cad61a-7047-4c01-9e09-70223b0e7667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:51.527258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:51.593422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 51/103] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:51.725946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c23f1-1bcf-4b57-b686-09ea593bb35e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:51.814351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad61a-7047-4c01-9e09-70223b0e7667 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:51.814557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:51.891775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c23f1-1bcf-4b57-b686-09ea593bb35e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:51.990421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887b946-1e3b-4e37-b51c-d973170de0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:51.991010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887b946-1e3b-4e37-b51c-d973170de0ed None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:51.991276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887b946-1e3b-4e37-b51c-d973170de0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:51.991556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887b946-1e3b-4e37-b51c-d973170de0ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.009019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad61a-7047-4c01-9e09-70223b0e7667 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:52.011310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887b946-1e3b-4e37-b51c-d973170de0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0887b946-1e3b-4e37-b51c-d973170de0ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:52.016408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:52.017374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 53/104] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:52.018967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887b946-1e3b-4e37-b51c-d973170de0ed None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:52.079088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db95f-81b8-4c3e-b1a8-6eb0e6b570d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:52.080469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db95f-81b8-4c3e-b1a8-6eb0e6b570d6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.081016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db95f-81b8-4c3e-b1a8-6eb0e6b570d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.081485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db95f-81b8-4c3e-b1a8-6eb0e6b570d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.101198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0db95f-81b8-4c3e-b1a8-6eb0e6b570d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bd0db95f-81b8-4c3e-b1a8-6eb0e6b570d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:52.107186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:52.108028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:45:52.109216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 52/105] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:45:52.110137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db95f-81b8-4c3e-b1a8-6eb0e6b570d6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:52.138165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:52.194889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887b946-1e3b-4e37-b51c-d973170de0ed None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:52.224364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:52.237876 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e233ef-10c7-4cfa-8402-ec307c23edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:52.238879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e233ef-10c7-4cfa-8402-ec307c23edd2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.239460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e233ef-10c7-4cfa-8402-ec307c23edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.240029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e233ef-10c7-4cfa-8402-ec307c23edd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.241532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e233ef-10c7-4cfa-8402-ec307c23edd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:52.243455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e233ef-10c7-4cfa-8402-ec307c23edd2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:52.245368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 54/106] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:52.250558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db95f-81b8-4c3e-b1a8-6eb0e6b570d6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:52.252544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924fe3-6470-47e9-9736-dc3a4fe16235 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.253131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924fe3-6470-47e9-9736-dc3a4fe16235 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.253605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924fe3-6470-47e9-9736-dc3a4fe16235 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.255317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 55/107] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:52.256215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924fe3-6470-47e9-9736-dc3a4fe16235 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:52.297122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:52.298908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.298908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.298908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.299484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:52.299792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:52.301210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:52.309966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 53/108] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:45:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:52.310814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:52.392886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924fe3-6470-47e9-9736-dc3a4fe16235 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:52.430375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a1230-b6c9-4bc9-80d4-aaf3967ec9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:52.431332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1230-b6c9-4bc9-80d4-aaf3967ec9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.431860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1230-b6c9-4bc9-80d4-aaf3967ec9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.432350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a1230-b6c9-4bc9-80d4-aaf3967ec9b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.433244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a1230-b6c9-4bc9-80d4-aaf3967ec9b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:52.433766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:52.433872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a1230-b6c9-4bc9-80d4-aaf3967ec9b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:52.435596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a1230-b6c9-4bc9-80d4-aaf3967ec9b0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:52.445662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 56/109] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:45:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:52.447362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d94fd-475a-4240-a3ba-42da18e00a1e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.447848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d94fd-475a-4240-a3ba-42da18e00a1e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.448320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d94fd-475a-4240-a3ba-42da18e00a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.462826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a300-5d1a-4e19-9a3b-6396cb210c9c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:52.468064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-723d94fd-475a-4240-a3ba-42da18e00a1e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:52.469555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-723d94fd-475a-4240-a3ba-42da18e00a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:52.503315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325916-d2a5-4ef6-a7e4-70e11dcd295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:52.503907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325916-d2a5-4ef6-a7e4-70e11dcd295e None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.504406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325916-d2a5-4ef6-a7e4-70e11dcd295e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.504909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325916-d2a5-4ef6-a7e4-70e11dcd295e None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.506152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325916-d2a5-4ef6-a7e4-70e11dcd295e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:52.508829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325916-d2a5-4ef6-a7e4-70e11dcd295e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:52.524274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:52.541779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 54/110] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:45:52 2022] POST /identity/v3/projects => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:45:52.546471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 57/111] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:52.551152 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d94fd-475a-4240-a3ba-42da18e00a1e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:52.551557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325916-d2a5-4ef6-a7e4-70e11dcd295e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:52.748878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d94fd-475a-4240-a3ba-42da18e00a1e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:52.749458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325916-d2a5-4ef6-a7e4-70e11dcd295e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:52.787132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:52.795948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e972e-b7a5-40d0-90e4-938c792dba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:52.796533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e972e-b7a5-40d0-90e4-938c792dba4a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.797197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e972e-b7a5-40d0-90e4-938c792dba4a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.797632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e972e-b7a5-40d0-90e4-938c792dba4a None admin] PATH_INFO: `/v3/users/35679996b94b422092fb4b6a4e9d61f4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.799305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e52c-8e89-4da1-b31d-bad6dcbbd223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:52.799962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e52c-8e89-4da1-b31d-bad6dcbbd223 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.800425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e52c-8e89-4da1-b31d-bad6dcbbd223 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.800674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e52c-8e89-4da1-b31d-bad6dcbbd223 None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.802849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e52c-8e89-4da1-b31d-bad6dcbbd223 None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:52.805111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e52c-8e89-4da1-b31d-bad6dcbbd223 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:52.806372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 58/112] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:52 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:52.807093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089502b-2741-4063-b472-3fb7e2358340 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.807378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089502b-2741-4063-b472-3fb7e2358340 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.808169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089502b-2741-4063-b472-3fb7e2358340 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.811062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 59/113] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:52.811295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752429-1532-4999-b59a-c34976e93c94 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.811547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752429-1532-4999-b59a-c34976e93c94 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.811829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752429-1532-4999-b59a-c34976e93c94 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.813343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 60/114] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:52.814638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afc15a-6f25-4efa-812f-58ba0ce60be7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.814874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afc15a-6f25-4efa-812f-58ba0ce60be7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.815158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afc15a-6f25-4efa-812f-58ba0ce60be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.820439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e972e-b7a5-40d0-90e4-938c792dba4a None admin] RBAC: Authorizing `identity:get_user(user_id=35679996b94b422092fb4b6a4e9d61f4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:52.822253 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e972e-b7a5-40d0-90e4-938c792dba4a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:52.823716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 55/115] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:52 2022] GET /identity/v3/users/35679996b94b422092fb4b6a4e9d61f4 => generated 289 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:52.824540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e972e-b7a5-40d0-90e4-938c792dba4a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:52.837629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-15afc15a-6f25-4efa-812f-58ba0ce60be7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:52.839034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-15afc15a-6f25-4efa-812f-58ba0ce60be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:52.898491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:52.922290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 61/116] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:52.925740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46ff5-e7c4-4847-bf5c-c5e0ddfd5511 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.926829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46ff5-e7c4-4847-bf5c-c5e0ddfd5511 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.927567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46ff5-e7c4-4847-bf5c-c5e0ddfd5511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.929177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e972e-b7a5-40d0-90e4-938c792dba4a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:52.957556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-caf46ff5-e7c4-4847-bf5c-c5e0ddfd5511 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:52.959635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-caf46ff5-e7c4-4847-bf5c-c5e0ddfd5511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:52.966112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b9832-a213-4000-b4c1-b1353413a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:52.966749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b9832-a213-4000-b4c1-b1353413a288 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:52.967087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b9832-a213-4000-b4c1-b1353413a288 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:52.967410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b9832-a213-4000-b4c1-b1353413a288 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:52.968546 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b9832-a213-4000-b4c1-b1353413a288 None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:52.970368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b9832-a213-4000-b4c1-b1353413a288 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:52.972301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 56/117] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:52 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:52.973261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b9832-a213-4000-b4c1-b1353413a288 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.045594 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:53.056164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 62/118] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:53.056845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46ff5-e7c4-4847-bf5c-c5e0ddfd5511 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.098221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b9832-a213-4000-b4c1-b1353413a288 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:53.134045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b6e53-9cc7-4974-8d68-0e6d894eccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:53.134724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6e53-9cc7-4974-8d68-0e6d894eccef None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.135010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6e53-9cc7-4974-8d68-0e6d894eccef None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.135300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b6e53-9cc7-4974-8d68-0e6d894eccef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.203127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46ff5-e7c4-4847-bf5c-c5e0ddfd5511 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:53.220850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b6e53-9cc7-4974-8d68-0e6d894eccef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:53.222632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b6e53-9cc7-4974-8d68-0e6d894eccef None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:53.222850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:53.254075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29841b5c-17db-41b2-940c-0450df8a0846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:53.255176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29841b5c-17db-41b2-940c-0450df8a0846 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.255467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29841b5c-17db-41b2-940c-0450df8a0846 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.255750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29841b5c-17db-41b2-940c-0450df8a0846 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.270118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29841b5c-17db-41b2-940c-0450df8a0846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-29841b5c-17db-41b2-940c-0450df8a0846 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:53.276899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:53.277776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:53.278562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 63/119] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:53.279206 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29841b5c-17db-41b2-940c-0450df8a0846 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.299116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:53.351645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 57/120] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:45:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:53.352849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b6e53-9cc7-4974-8d68-0e6d894eccef None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.414701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29841b5c-17db-41b2-940c-0450df8a0846 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:53.450807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35320527-7a5a-400d-b929-44f1a47d95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:53.451476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35320527-7a5a-400d-b929-44f1a47d95b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.451822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35320527-7a5a-400d-b929-44f1a47d95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.452102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35320527-7a5a-400d-b929-44f1a47d95b0 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329/users/f259ec9489364c74a1ba8b68ff8cdbb4/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.454095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35320527-7a5a-400d-b929-44f1a47d95b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0229e1f6c84e43d0ab052db94ab62329, user_id=f259ec9489364c74a1ba8b68ff8cdbb4, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:53.455588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35320527-7a5a-400d-b929-44f1a47d95b0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:53.468137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b6e53-9cc7-4974-8d68-0e6d894eccef None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:53.470294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 64/121] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:45:53 2022] PUT /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329/users/f259ec9489364c74a1ba8b68ff8cdbb4/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:45:53.471115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35320527-7a5a-400d-b929-44f1a47d95b0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.511500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:53.537014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4388a2-d8cb-48c3-a344-92aae5f6ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:53.537974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4388a2-d8cb-48c3-a344-92aae5f6ea46 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.538457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4388a2-d8cb-48c3-a344-92aae5f6ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.538898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4388a2-d8cb-48c3-a344-92aae5f6ea46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.556201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4388a2-d8cb-48c3-a344-92aae5f6ea46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8d4388a2-d8cb-48c3-a344-92aae5f6ea46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:53.563393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:53.564915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:45:53.565731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:45:53.568838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 58/122] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:53.570477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4388a2-d8cb-48c3-a344-92aae5f6ea46 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.595521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:53.596794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35320527-7a5a-400d-b929-44f1a47d95b0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:53.645545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:53.646838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.647298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.648035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.649513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:53.650031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:53.652394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:53.665248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 65/123] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:53.667711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.708341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4388a2-d8cb-48c3-a344-92aae5f6ea46 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:53.745744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee096f-2674-46b1-b132-456e369fd39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:53.746513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee096f-2674-46b1-b132-456e369fd39b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.746961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee096f-2674-46b1-b132-456e369fd39b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.747310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee096f-2674-46b1-b132-456e369fd39b None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.748867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee096f-2674-46b1-b132-456e369fd39b None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:53.750487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee096f-2674-46b1-b132-456e369fd39b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:53.753106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 59/124] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:53.754106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee096f-2674-46b1-b132-456e369fd39b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.782992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:53.792434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7cac2-dee4-4532-8569-5f717831804a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:53.842103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85aa1-2ac0-4ab6-9ddd-8d13488fe3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:53.843242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85aa1-2ac0-4ab6-9ddd-8d13488fe3df None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.843671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85aa1-2ac0-4ab6-9ddd-8d13488fe3df None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.844657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85aa1-2ac0-4ab6-9ddd-8d13488fe3df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.862906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d85aa1-2ac0-4ab6-9ddd-8d13488fe3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:53.866400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f4d85aa1-2ac0-4ab6-9ddd-8d13488fe3df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:53.870670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:53.872263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:53.873246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:53.878463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 66/125] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:53.879029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85aa1-2ac0-4ab6-9ddd-8d13488fe3df None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:53.887324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee096f-2674-46b1-b132-456e369fd39b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:53.927478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:53.927790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:53.928036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:53.928316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:53.929094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:53.929413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:53.930914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:53.940159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 60/126] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:53.944713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.023779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85aa1-2ac0-4ab6-9ddd-8d13488fe3df None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:54.055698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0f73e-3d30-4cde-b3b5-85b2cedef391 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:54.069680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042285-234b-43ac-a912-33b0ea4f26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:54.071064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042285-234b-43ac-a912-33b0ea4f26a3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:54.071778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042285-234b-43ac-a912-33b0ea4f26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:54.072247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b042285-234b-43ac-a912-33b0ea4f26a3 None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:54.073826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042285-234b-43ac-a912-33b0ea4f26a3 None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:54.075923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b042285-234b-43ac-a912-33b0ea4f26a3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:54.082847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 67/127] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:54.083854 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042285-234b-43ac-a912-33b0ea4f26a3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.096136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:54.097044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:54.097805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:54.098546 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:54.099885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] RBAC: Adding query filter params (role.id=26eaaf4903bb4dd1a32f47236b451b7d, scope.project.id=0229e1f6c84e43d0ab052db94ab62329, user.id=35679996b94b422092fb4b6a4e9d61f4) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:54.100518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:54.102854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:54.109879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 61/128] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:45:53 2022] GET /identity/v3/role_assignments?user.id=35679996b94b422092fb4b6a4e9d61f4&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=26eaaf4903bb4dd1a32f47236b451b7d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:54.110340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:54.111914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.150050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:54.303869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b042285-234b-43ac-a912-33b0ea4f26a3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:54.306515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80db8-aea5-4cb9-958a-41dcf9734f18 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:54.340957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ac254-0307-4e95-8d49-964c733dad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:54.341554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac254-0307-4e95-8d49-964c733dad78 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:54.341840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac254-0307-4e95-8d49-964c733dad78 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:54.342137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac254-0307-4e95-8d49-964c733dad78 None admin] PATH_INFO: `/v3/users/c765c31c0c1d406383a20f8e12957d4e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:54.344047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ac254-0307-4e95-8d49-964c733dad78 None admin] RBAC: Authorizing `identity:get_user(user_id=c765c31c0c1d406383a20f8e12957d4e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:54.345604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ac254-0307-4e95-8d49-964c733dad78 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:54.346933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:54.347205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 62/129] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:54 2022] GET /identity/v3/users/c765c31c0c1d406383a20f8e12957d4e => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:54.347992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ac254-0307-4e95-8d49-964c733dad78 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.348096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:54.348678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:54.349208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:54.350077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:54.350582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:54.352454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:54.362209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 68/130] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:54.363413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.457003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:54.462622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:54.467668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ac254-0307-4e95-8d49-964c733dad78 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:54.505254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaae229-3913-4124-8dd6-53af08bec297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:54.505862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae229-3913-4124-8dd6-53af08bec297 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:54.506151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae229-3913-4124-8dd6-53af08bec297 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:54.506431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaae229-3913-4124-8dd6-53af08bec297 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:54.507578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaae229-3913-4124-8dd6-53af08bec297 None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:54.508506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f5b25-d744-4935-bfc5-56cc2b400e72 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:54.509042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaae229-3913-4124-8dd6-53af08bec297 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:54.513025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 63/131] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:54 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:54.513025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaae229-3913-4124-8dd6-53af08bec297 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.567768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c67b8e-94cc-4cac-baa2-ea8c59b8bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:54.568414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c67b8e-94cc-4cac-baa2-ea8c59b8bfeb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:54.568697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c67b8e-94cc-4cac-baa2-ea8c59b8bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:54.568993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c67b8e-94cc-4cac-baa2-ea8c59b8bfeb None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:54.573250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c67b8e-94cc-4cac-baa2-ea8c59b8bfeb None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:54.576215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c67b8e-94cc-4cac-baa2-ea8c59b8bfeb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:54.577901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 69/132] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:54 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:54.579908 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c67b8e-94cc-4cac-baa2-ea8c59b8bfeb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.719825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c67b8e-94cc-4cac-baa2-ea8c59b8bfeb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:54.756451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaae229-3913-4124-8dd6-53af08bec297 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:54.778772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f34a-1c70-4767-9081-b15800c03096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:54.779464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f34a-1c70-4767-9081-b15800c03096 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:54.779745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f34a-1c70-4767-9081-b15800c03096 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:54.780020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537f34a-1c70-4767-9081-b15800c03096 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329/users/f259ec9489364c74a1ba8b68ff8cdbb4/roles/6c35be71800f4fd791345d48ca3f6ed2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:54.784924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537f34a-1c70-4767-9081-b15800c03096 None admin] RBAC: Authorizing `identity:create_grant(project_id=0229e1f6c84e43d0ab052db94ab62329, user_id=f259ec9489364c74a1ba8b68ff8cdbb4, role_id=6c35be71800f4fd791345d48ca3f6ed2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:54.786737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5537f34a-1c70-4767-9081-b15800c03096 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:54.822116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 70/133] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:45:54 2022] PUT /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329/users/f259ec9489364c74a1ba8b68ff8cdbb4/roles/6c35be71800f4fd791345d48ca3f6ed2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:45:54.823185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f34a-1c70-4767-9081-b15800c03096 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.833610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fc13-1e5d-4276-9873-972e02deb2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:54.834953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fc13-1e5d-4276-9873-972e02deb2bd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:54.834953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fc13-1e5d-4276-9873-972e02deb2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:54.834953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fc13-1e5d-4276-9873-972e02deb2bd None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:54.835985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839fc13-1e5d-4276-9873-972e02deb2bd None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:54.837557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839fc13-1e5d-4276-9873-972e02deb2bd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:54.839589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 64/134] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:54 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:54.846930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fc13-1e5d-4276-9873-972e02deb2bd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:54.865008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:54.868436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:55.051053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fc13-1e5d-4276-9873-972e02deb2bd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:55.110252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537f34a-1c70-4767-9081-b15800c03096 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:55.117359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b8cef-742b-468e-9f4d-bf883accf059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:55.119457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b8cef-742b-468e-9f4d-bf883accf059 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:55.119892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b8cef-742b-468e-9f4d-bf883accf059 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:55.120311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b8cef-742b-468e-9f4d-bf883accf059 None admin] PATH_INFO: `/v3/projects/2ccb98feecd34c67a6acb4db9d5c724e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:55.124689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b8cef-742b-468e-9f4d-bf883accf059 None admin] RBAC: Authorizing `identity:get_project(project_id=2ccb98feecd34c67a6acb4db9d5c724e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:55.126349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b8cef-742b-468e-9f4d-bf883accf059 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:55.129041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 65/135] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:54 2022] GET /identity/v3/projects/2ccb98feecd34c67a6acb4db9d5c724e => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:55.135154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b8cef-742b-468e-9f4d-bf883accf059 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:55.162183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2609f10-c458-4383-8c4a-53e66a9c1fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:55.163371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609f10-c458-4383-8c4a-53e66a9c1fc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:55.163657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609f10-c458-4383-8c4a-53e66a9c1fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:55.163931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2609f10-c458-4383-8c4a-53e66a9c1fc6 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329/users/c765c31c0c1d406383a20f8e12957d4e/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:55.166341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2609f10-c458-4383-8c4a-53e66a9c1fc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0229e1f6c84e43d0ab052db94ab62329, user_id=c765c31c0c1d406383a20f8e12957d4e, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:55.168673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2609f10-c458-4383-8c4a-53e66a9c1fc6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:55.187849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 71/136] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:45:54 2022] PUT /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329/users/c765c31c0c1d406383a20f8e12957d4e/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:45:55.189751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fd0eb-d644-44e6-924f-bf6c656fc751 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:55.190041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fd0eb-d644-44e6-924f-bf6c656fc751 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:55.190421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fd0eb-d644-44e6-924f-bf6c656fc751 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:55.192685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 72/137] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:55.199993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e29b-7584-4269-8a02-12c696f69d16 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:55.200340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e29b-7584-4269-8a02-12c696f69d16 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:55.200677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e29b-7584-4269-8a02-12c696f69d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:55.238804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3b40e29b-7584-4269-8a02-12c696f69d16 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:55.242112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3b40e29b-7584-4269-8a02-12c696f69d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:55.291130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:55.312266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b8cef-742b-468e-9f4d-bf883accf059 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:55.350899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4216bab-4f23-47a1-8efd-5cd402eb2481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:55.351584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4216bab-4f23-47a1-8efd-5cd402eb2481 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:55.351873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4216bab-4f23-47a1-8efd-5cd402eb2481 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:55.352157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4216bab-4f23-47a1-8efd-5cd402eb2481 None admin] PATH_INFO: `/v3/projects/2ccb98feecd34c67a6acb4db9d5c724e/users/f259ec9489364c74a1ba8b68ff8cdbb4/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:55.354188 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4216bab-4f23-47a1-8efd-5cd402eb2481 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ccb98feecd34c67a6acb4db9d5c724e, user_id=f259ec9489364c74a1ba8b68ff8cdbb4, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:55.355802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4216bab-4f23-47a1-8efd-5cd402eb2481 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:55.389955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 66/138] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:45:55 2022] PUT /identity/v3/projects/2ccb98feecd34c67a6acb4db9d5c724e/users/f259ec9489364c74a1ba8b68ff8cdbb4/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:45:55.427863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 73/139] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:55.816751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4216bab-4f23-47a1-8efd-5cd402eb2481 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:55.878839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7fdb-fc2f-490e-ad9a-332832fe6a2f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:55.879173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7fdb-fc2f-490e-ad9a-332832fe6a2f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:55.879401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7fdb-fc2f-490e-ad9a-332832fe6a2f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:55.880757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 74/140] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:55.890193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18049344-525e-475f-94f2-3be7b675baf2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:55.890477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18049344-525e-475f-94f2-3be7b675baf2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:55.890754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18049344-525e-475f-94f2-3be7b675baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:55.906740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:55.934019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-18049344-525e-475f-94f2-3be7b675baf2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:55.935236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-18049344-525e-475f-94f2-3be7b675baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:56.004410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4216bab-4f23-47a1-8efd-5cd402eb2481 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:56.068848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab51e-9bde-4f04-9aba-c8e7ecf83a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:56.069515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab51e-9bde-4f04-9aba-c8e7ecf83a5b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:56.069805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab51e-9bde-4f04-9aba-c8e7ecf83a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:56.070084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab51e-9bde-4f04-9aba-c8e7ecf83a5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:56.071930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebab51e-9bde-4f04-9aba-c8e7ecf83a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:56.073429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebab51e-9bde-4f04-9aba-c8e7ecf83a5b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:56.075184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 67/141] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:56.080870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab51e-9bde-4f04-9aba-c8e7ecf83a5b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:56.081461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 75/142] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:56.101803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:56.202065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab51e-9bde-4f04-9aba-c8e7ecf83a5b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:56.247770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baaa2a0-dd72-4682-a8a9-897f32fb2081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:56.248395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaa2a0-dd72-4682-a8a9-897f32fb2081 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:56.248678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaa2a0-dd72-4682-a8a9-897f32fb2081 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:56.249251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baaa2a0-dd72-4682-a8a9-897f32fb2081 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:56.249922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baaa2a0-dd72-4682-a8a9-897f32fb2081 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:56.251357 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baaa2a0-dd72-4682-a8a9-897f32fb2081 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:56.275434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 68/143] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:45:56 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:45:56.446611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18049344-525e-475f-94f2-3be7b675baf2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:56.570464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18049344-525e-475f-94f2-3be7b675baf2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:56.602491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:56.608131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcb7ba-9dd5-45b5-93c2-3bea09e5795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:56.609055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb7ba-9dd5-45b5-93c2-3bea09e5795e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:56.609553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb7ba-9dd5-45b5-93c2-3bea09e5795e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:56.610028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcb7ba-9dd5-45b5-93c2-3bea09e5795e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:56.621661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcb7ba-9dd5-45b5-93c2-3bea09e5795e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-78bcb7ba-9dd5-45b5-93c2-3bea09e5795e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:56.627163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:56.628057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:45:56.628939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:56.631246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 76/144] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:56.638204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baaa2a0-dd72-4682-a8a9-897f32fb2081 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:56.740185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:56.775447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baaa2a0-dd72-4682-a8a9-897f32fb2081 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:56.814663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aeba55-a59e-4274-be9e-0f39dfeef13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:56.814663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeba55-a59e-4274-be9e-0f39dfeef13b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:56.814663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeba55-a59e-4274-be9e-0f39dfeef13b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:56.814663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeba55-a59e-4274-be9e-0f39dfeef13b None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:56.815213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aeba55-a59e-4274-be9e-0f39dfeef13b None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:56.815477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aeba55-a59e-4274-be9e-0f39dfeef13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:56.816876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aeba55-a59e-4274-be9e-0f39dfeef13b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:56.825721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 69/145] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:45:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:56.832179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcb7ba-9dd5-45b5-93c2-3bea09e5795e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:56.991043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcb7ba-9dd5-45b5-93c2-3bea09e5795e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:57.024881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e4c7-67b6-4040-a445-95825ddcb4b9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:57.025233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e4c7-67b6-4040-a445-95825ddcb4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:57.025485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3e4c7-67b6-4040-a445-95825ddcb4b9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:57.026824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 70/146] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:45:57.031946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff1e11-8b93-4048-8eee-b6e3cb6ce005 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:57.032232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff1e11-8b93-4048-8eee-b6e3cb6ce005 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:57.032512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff1e11-8b93-4048-8eee-b6e3cb6ce005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:57.054393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be84ac-02b0-4863-8f68-a5b5d49186ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:57.055043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be84ac-02b0-4863-8f68-a5b5d49186ab None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:57.055322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be84ac-02b0-4863-8f68-a5b5d49186ab None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:57.055596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be84ac-02b0-4863-8f68-a5b5d49186ab None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:57.056901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be84ac-02b0-4863-8f68-a5b5d49186ab None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:57.058375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be84ac-02b0-4863-8f68-a5b5d49186ab None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:57.059943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 77/147] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:56 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:57.064131 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4dff1e11-8b93-4048-8eee-b6e3cb6ce005 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:57.067562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be84ac-02b0-4863-8f68-a5b5d49186ab None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:57.068712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4dff1e11-8b93-4048-8eee-b6e3cb6ce005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:57.195015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:57.220220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 71/148] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:57.248774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be84ac-02b0-4863-8f68-a5b5d49186ab None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:57.290725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299ad58-72b6-42cc-ab2e-0d9fe1e6f6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:57.291347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299ad58-72b6-42cc-ab2e-0d9fe1e6f6fd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:57.291625 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299ad58-72b6-42cc-ab2e-0d9fe1e6f6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:57.291899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299ad58-72b6-42cc-ab2e-0d9fe1e6f6fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:57.373845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299ad58-72b6-42cc-ab2e-0d9fe1e6f6fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:57.375568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299ad58-72b6-42cc-ab2e-0d9fe1e6f6fd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:57.435877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:57.483473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 78/149] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:45:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:57.489119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff1e11-8b93-4048-8eee-b6e3cb6ce005 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:57.562648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:57.589010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299ad58-72b6-42cc-ab2e-0d9fe1e6f6fd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:57.646588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff1e11-8b93-4048-8eee-b6e3cb6ce005 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:57.734538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b69a7f-033f-4ca3-bc91-0e99ed2ba57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:57.735183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69a7f-033f-4ca3-bc91-0e99ed2ba57d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:57.735469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69a7f-033f-4ca3-bc91-0e99ed2ba57d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:57.735744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69a7f-033f-4ca3-bc91-0e99ed2ba57d None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:57.737465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b69a7f-033f-4ca3-bc91-0e99ed2ba57d None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:57.738910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b69a7f-033f-4ca3-bc91-0e99ed2ba57d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:57.740539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 72/150] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:57 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:57.748319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b69a7f-033f-4ca3-bc91-0e99ed2ba57d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:57.837767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299ad58-72b6-42cc-ab2e-0d9fe1e6f6fd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:57.896195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68add6-a917-4ed7-bd87-2ef66199b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:57.897283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68add6-a917-4ed7-bd87-2ef66199b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:57.897582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68add6-a917-4ed7-bd87-2ef66199b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:57.897860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68add6-a917-4ed7-bd87-2ef66199b2a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:57.919657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68add6-a917-4ed7-bd87-2ef66199b2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-fc68add6-a917-4ed7-bd87-2ef66199b2a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:57.925521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:57.926482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:45:57.927262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:45:57.928354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 79/151] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:45:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:45:57.934352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68add6-a917-4ed7-bd87-2ef66199b2a6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:57.974305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:58.007910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b69a7f-033f-4ca3-bc91-0e99ed2ba57d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:58.071539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:58.097815 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56fb42-106a-4225-bb7b-c6729d268314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:58.098376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56fb42-106a-4225-bb7b-c6729d268314 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:58.098661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56fb42-106a-4225-bb7b-c6729d268314 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:58.098947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56fb42-106a-4225-bb7b-c6729d268314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:58.099691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56fb42-106a-4225-bb7b-c6729d268314 None admin] RBAC: Adding query filter params (role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=0229e1f6c84e43d0ab052db94ab62329, user.id=f259ec9489364c74a1ba8b68ff8cdbb4) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:58.099996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56fb42-106a-4225-bb7b-c6729d268314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:58.101468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56fb42-106a-4225-bb7b-c6729d268314 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:58.106761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68add6-a917-4ed7-bd87-2ef66199b2a6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:58.111675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 73/152] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:45:57 2022] GET /identity/v3/role_assignments?user.id=f259ec9489364c74a1ba8b68ff8cdbb4&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=51dbfe81239845968f102b6b956c7061 => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:58.120673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719f35f-89f4-480c-9c1e-393d9f62f237 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:58.121224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719f35f-89f4-480c-9c1e-393d9f62f237 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:58.121709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719f35f-89f4-480c-9c1e-393d9f62f237 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:58.123281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 74/153] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:45:58.129922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee3b20-68b3-4041-828a-22c748e4fc93 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:58.130490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee3b20-68b3-4041-828a-22c748e4fc93 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:58.130940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee3b20-68b3-4041-828a-22c748e4fc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:58.156947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dcee3b20-68b3-4041-828a-22c748e4fc93 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:58.159671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dcee3b20-68b3-4041-828a-22c748e4fc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:58.168166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:58.169130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:58.169597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:58.170046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:58.170885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:58.171373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:58.172928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:58.185269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 80/154] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:45:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:58.191453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:58.299996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 75/155] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:58.309009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:58.331585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f21c9-3707-4ce7-b7f4-9de6726c0c9e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:58.368689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a246f4-fd35-41f1-9b27-29e6118c42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:58.369304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a246f4-fd35-41f1-9b27-29e6118c42b4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:58.369587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a246f4-fd35-41f1-9b27-29e6118c42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:58.369863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a246f4-fd35-41f1-9b27-29e6118c42b4 None admin] PATH_INFO: `/v3/users/35679996b94b422092fb4b6a4e9d61f4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:58.373388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a246f4-fd35-41f1-9b27-29e6118c42b4 None admin] RBAC: Authorizing `identity:get_user(user_id=35679996b94b422092fb4b6a4e9d61f4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:58.375274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a246f4-fd35-41f1-9b27-29e6118c42b4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:58.377902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 81/156] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:58 2022] GET /identity/v3/users/35679996b94b422092fb4b6a4e9d61f4 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:45:58.383205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee3b20-68b3-4041-828a-22c748e4fc93 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:58.514260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee3b20-68b3-4041-828a-22c748e4fc93 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:58.541364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:58.560124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c02933-57a3-40ef-89b8-62ffd135586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:58.560765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02933-57a3-40ef-89b8-62ffd135586d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:58.561069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02933-57a3-40ef-89b8-62ffd135586d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:58.561344 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c02933-57a3-40ef-89b8-62ffd135586d None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:58.562469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c02933-57a3-40ef-89b8-62ffd135586d None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:58.563932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c02933-57a3-40ef-89b8-62ffd135586d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:58.566484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 76/157] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:58 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:58.571782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a246f4-fd35-41f1-9b27-29e6118c42b4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:58.682220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a246f4-fd35-41f1-9b27-29e6118c42b4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:58.720254 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261772a6-8110-4d89-adf3-4f35669ade58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:58.720959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261772a6-8110-4d89-adf3-4f35669ade58 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:58.721265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261772a6-8110-4d89-adf3-4f35669ade58 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:58.721543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261772a6-8110-4d89-adf3-4f35669ade58 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329/users/35679996b94b422092fb4b6a4e9d61f4/roles/26eaaf4903bb4dd1a32f47236b451b7d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:58.726260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261772a6-8110-4d89-adf3-4f35669ade58 None admin] RBAC: Authorizing `identity:create_grant(project_id=0229e1f6c84e43d0ab052db94ab62329, user_id=35679996b94b422092fb4b6a4e9d61f4, role_id=26eaaf4903bb4dd1a32f47236b451b7d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:58.727715 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261772a6-8110-4d89-adf3-4f35669ade58 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:58.755961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 82/158] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:45:58 2022] PUT /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329/users/35679996b94b422092fb4b6a4e9d61f4/roles/26eaaf4903bb4dd1a32f47236b451b7d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:45:58.766508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c02933-57a3-40ef-89b8-62ffd135586d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:58.900828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c02933-57a3-40ef-89b8-62ffd135586d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:58.945259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63ba84-f428-4b0c-aee7-cd4518aad174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:58.945840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63ba84-f428-4b0c-aee7-cd4518aad174 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:58.946132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63ba84-f428-4b0c-aee7-cd4518aad174 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:58.946411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63ba84-f428-4b0c-aee7-cd4518aad174 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:58.960020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63ba84-f428-4b0c-aee7-cd4518aad174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-cf63ba84-f428-4b0c-aee7-cd4518aad174 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:45:58.967331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:45:58.968303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:45:58.969172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 77/159] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:45:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:45:58.975949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261772a6-8110-4d89-adf3-4f35669ade58 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:58.990546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:59.113044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261772a6-8110-4d89-adf3-4f35669ade58 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:59.157073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba299e9-33e7-4d6b-a47a-5c58ab403ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:59.157701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba299e9-33e7-4d6b-a47a-5c58ab403ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:59.158042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba299e9-33e7-4d6b-a47a-5c58ab403ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:59.158333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba299e9-33e7-4d6b-a47a-5c58ab403ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:59.159049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba299e9-33e7-4d6b-a47a-5c58ab403ce0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:45:59.159357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba299e9-33e7-4d6b-a47a-5c58ab403ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:59.160749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba299e9-33e7-4d6b-a47a-5c58ab403ce0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:59.169763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 83/160] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:45:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:59.175513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63ba84-f428-4b0c-aee7-cd4518aad174 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:59.211151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07d8c-ec13-48a3-bfd7-920234c83262 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:59.211341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07d8c-ec13-48a3-bfd7-920234c83262 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:59.212481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d07d8c-ec13-48a3-bfd7-920234c83262 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:59.213531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 84/161] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:45:59.220673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3fcaa-e314-4623-ad84-672cc9ca5d21 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:59.221320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3fcaa-e314-4623-ad84-672cc9ca5d21 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:59.221799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3fcaa-e314-4623-ad84-672cc9ca5d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:59.258985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-29d3fcaa-e314-4623-ad84-672cc9ca5d21 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:59.260916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-29d3fcaa-e314-4623-ad84-672cc9ca5d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:59.269336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:59.374999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 85/162] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:45:59.394444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63ba84-f428-4b0c-aee7-cd4518aad174 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:59.449609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffe2ac-60f0-47e8-99a9-eedc3b318cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:59.450254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffe2ac-60f0-47e8-99a9-eedc3b318cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:59.450537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffe2ac-60f0-47e8-99a9-eedc3b318cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:59.450912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffe2ac-60f0-47e8-99a9-eedc3b318cf7 None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:59.453748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffe2ac-60f0-47e8-99a9-eedc3b318cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:59.455482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffe2ac-60f0-47e8-99a9-eedc3b318cf7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:59.457390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 78/163] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:45:59 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:45:59.462934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3fcaa-e314-4623-ad84-672cc9ca5d21 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:45:59.469594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:59.476735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d30f8-8d57-4221-8a26-f1cbcb3a673b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:59.477356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d30f8-8d57-4221-8a26-f1cbcb3a673b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:59.477830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d30f8-8d57-4221-8a26-f1cbcb3a673b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:59.479400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 79/164] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:45:59.484433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bbcdb-60b0-46df-a944-443e6adf6181 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:59.484934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bbcdb-60b0-46df-a944-443e6adf6181 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:59.485422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bbcdb-60b0-46df-a944-443e6adf6181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:59.521514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-121bbcdb-60b0-46df-a944-443e6adf6181 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:45:59.523071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-121bbcdb-60b0-46df-a944-443e6adf6181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:45:59.651768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3fcaa-e314-4623-ad84-672cc9ca5d21 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:45:59.662495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 80/165] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:45:59.722670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307980d-fdda-4335-a2a6-26bbb893cedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:45:59.723213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307980d-fdda-4335-a2a6-26bbb893cedb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:45:59.723556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307980d-fdda-4335-a2a6-26bbb893cedb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:45:59.723835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307980d-fdda-4335-a2a6-26bbb893cedb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:45:59.827708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307980d-fdda-4335-a2a6-26bbb893cedb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:45:59.829224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307980d-fdda-4335-a2a6-26bbb893cedb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:45:59.831094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:45:59.955909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 86/166] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:45:59.961089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bbcdb-60b0-46df-a944-443e6adf6181 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:00.004950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307980d-fdda-4335-a2a6-26bbb893cedb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:00.028470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:00.096714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bbcdb-60b0-46df-a944-443e6adf6181 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:00.166607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8399-1823-4684-ab8c-3ab1988d3090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:00.167245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8399-1823-4684-ab8c-3ab1988d3090 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:00.167525 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8399-1823-4684-ab8c-3ab1988d3090 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:00.167799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d8399-1823-4684-ab8c-3ab1988d3090 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:00.171178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8399-1823-4684-ab8c-3ab1988d3090 None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:00.172629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d8399-1823-4684-ab8c-3ab1988d3090 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:00.174902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 81/167] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:45:59 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:00.182804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8399-1823-4684-ab8c-3ab1988d3090 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:00.208225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307980d-fdda-4335-a2a6-26bbb893cedb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:00.211593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:00.251603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9a32c-f243-49b6-b772-068e3f5588ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:00.252745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9a32c-f243-49b6-b772-068e3f5588ec None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:00.253269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9a32c-f243-49b6-b772-068e3f5588ec None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:00.253740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9a32c-f243-49b6-b772-068e3f5588ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:00.265193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9a32c-f243-49b6-b772-068e3f5588ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c1f9a32c-f243-49b6-b772-068e3f5588ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:00.270849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:00.271875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:00.272673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:00.274551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 87/168] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:00.285793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9a32c-f243-49b6-b772-068e3f5588ec None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:00.418007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d8399-1823-4684-ab8c-3ab1988d3090 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:00.427847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9a32c-f243-49b6-b772-068e3f5588ec None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:00.449543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:00.486495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:00.487343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:00.487764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:00.488211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:00.489048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:00.489493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:00.491120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:00.497659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:00.498470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:00.498890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:00.499566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:00.500427 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] RBAC: Adding query filter params (role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=0229e1f6c84e43d0ab052db94ab62329, user.id=f259ec9489364c74a1ba8b68ff8cdbb4) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:00.500887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:00.502499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:00.508551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 88/169] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:00.509608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:00.511591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 82/170] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:00 2022] GET /identity/v3/role_assignments?user.id=f259ec9489364c74a1ba8b68ff8cdbb4&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:00.514435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:00.550416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:00.671708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6dd67b-b5d4-42d5-8c37-6908cb7c512a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:00.745500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927413b2-fa27-441f-a442-961443e0471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:00.746386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927413b2-fa27-441f-a442-961443e0471c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:00.746967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927413b2-fa27-441f-a442-961443e0471c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:00.748936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16853e-50fc-4073-af30-c4fe5755d42d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:00.749674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927413b2-fa27-441f-a442-961443e0471c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:00.771615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927413b2-fa27-441f-a442-961443e0471c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-927413b2-fa27-441f-a442-961443e0471c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:00.780966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:00.782157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:00.783191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:00.787099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 89/171] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:00.793542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927413b2-fa27-441f-a442-961443e0471c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:00.826097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d327116-6bbe-4269-81f2-a80634f0eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:00.826773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d327116-6bbe-4269-81f2-a80634f0eeef None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:00.827100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d327116-6bbe-4269-81f2-a80634f0eeef None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:00.827381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d327116-6bbe-4269-81f2-a80634f0eeef None admin] PATH_INFO: `/v3/users/c765c31c0c1d406383a20f8e12957d4e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:00.828539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d327116-6bbe-4269-81f2-a80634f0eeef None admin] RBAC: Authorizing `identity:get_user(user_id=c765c31c0c1d406383a20f8e12957d4e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:00.830603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d327116-6bbe-4269-81f2-a80634f0eeef None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:00.832443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 83/172] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:00 2022] GET /identity/v3/users/c765c31c0c1d406383a20f8e12957d4e => generated 247 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:00.842104 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d327116-6bbe-4269-81f2-a80634f0eeef None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:00.901553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:00.920000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927413b2-fa27-441f-a442-961443e0471c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:00.933384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:00.962240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:00.963160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:00.963584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:00.963999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:00.964807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:00.965282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:00.966876 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:00.979967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 90/173] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:00.993977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:01.007479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d327116-6bbe-4269-81f2-a80634f0eeef None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:01.062597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa43748-563a-448e-8596-ac012c9ac43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:01.063279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa43748-563a-448e-8596-ac012c9ac43c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.063576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa43748-563a-448e-8596-ac012c9ac43c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.063772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa43748-563a-448e-8596-ac012c9ac43c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.112573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c7496-9475-4180-bc46-73195dac160f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:01.148923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cfcd2-3571-4568-8a19-017e8562440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:01.149853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cfcd2-3571-4568-8a19-017e8562440c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.150288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cfcd2-3571-4568-8a19-017e8562440c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.150704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cfcd2-3571-4568-8a19-017e8562440c None admin] PATH_INFO: `/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.152002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cfcd2-3571-4568-8a19-017e8562440c None admin] RBAC: Authorizing `identity:get_user(user_id=f259ec9489364c74a1ba8b68ff8cdbb4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:01.153627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cfcd2-3571-4568-8a19-017e8562440c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:01.155385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 91/174] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:00 2022] GET /identity/v3/users/f259ec9489364c74a1ba8b68ff8cdbb4 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:01.161452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cfcd2-3571-4568-8a19-017e8562440c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:01.178703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:01.196603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa43748-563a-448e-8596-ac012c9ac43c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:01.198091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa43748-563a-448e-8596-ac012c9ac43c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:01.270900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cfcd2-3571-4568-8a19-017e8562440c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:01.307090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0eae62-d765-4e13-84e4-c15726c868a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:01.307948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eae62-d765-4e13-84e4-c15726c868a3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.308390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eae62-d765-4e13-84e4-c15726c868a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.308808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eae62-d765-4e13-84e4-c15726c868a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.315571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:01.381599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0eae62-d765-4e13-84e4-c15726c868a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:01.383139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0eae62-d765-4e13-84e4-c15726c868a3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:01.398531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:01.436125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 84/175] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:01.442439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa43748-563a-448e-8596-ac012c9ac43c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:01.536502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 92/176] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:01.542685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0eae62-d765-4e13-84e4-c15726c868a3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:01.650461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa43748-563a-448e-8596-ac012c9ac43c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:01.724458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336dad1-ad43-49ac-8503-438ad9f09d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:01.726705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dad1-ad43-49ac-8503-438ad9f09d3e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.728380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dad1-ad43-49ac-8503-438ad9f09d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.728860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336dad1-ad43-49ac-8503-438ad9f09d3e None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.730393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336dad1-ad43-49ac-8503-438ad9f09d3e None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:01.732780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336dad1-ad43-49ac-8503-438ad9f09d3e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:01.735261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 85/177] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:01 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:01.736782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1589a-6867-48b2-825b-3901c37df62c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.743276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0eae62-d765-4e13-84e4-c15726c868a3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:01.746880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1589a-6867-48b2-825b-3901c37df62c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.753159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1589a-6867-48b2-825b-3901c37df62c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.754815 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 86/178] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:01 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:01.760638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1589a-6867-48b2-825b-3901c37df62c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:01.775939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:01.780480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:01.809273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdd0b1-d50a-43b6-a1c6-941b3888b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:01.810252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd0b1-d50a-43b6-a1c6-941b3888b559 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.810757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd0b1-d50a-43b6-a1c6-941b3888b559 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.811249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdd0b1-d50a-43b6-a1c6-941b3888b559 None admin] PATH_INFO: `/v3/projects/2ccb98feecd34c67a6acb4db9d5c724e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.812874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdd0b1-d50a-43b6-a1c6-941b3888b559 None admin] RBAC: Authorizing `identity:get_project(project_id=2ccb98feecd34c67a6acb4db9d5c724e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:01.814757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdd0b1-d50a-43b6-a1c6-941b3888b559 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:01.816903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 93/179] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:01 2022] GET /identity/v3/projects/2ccb98feecd34c67a6acb4db9d5c724e => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:01.818358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac1a0-9ab3-42b1-991d-7c291997da6b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.818921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac1a0-9ab3-42b1-991d-7c291997da6b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.819302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac1a0-9ab3-42b1-991d-7c291997da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.838781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1a0ac1a0-9ab3-42b1-991d-7c291997da6b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:01.840344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1a0ac1a0-9ab3-42b1-991d-7c291997da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:01.887339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1589a-6867-48b2-825b-3901c37df62c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:01.918334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 94/180] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:01.923377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc28aa0-ebb8-4a83-b8db-29ca3d528355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:01.924031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28aa0-ebb8-4a83-b8db-29ca3d528355 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.924382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28aa0-ebb8-4a83-b8db-29ca3d528355 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.924656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28aa0-ebb8-4a83-b8db-29ca3d528355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.925435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc28aa0-ebb8-4a83-b8db-29ca3d528355 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=0229e1f6c84e43d0ab052db94ab62329, user.id=c765c31c0c1d406383a20f8e12957d4e) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:01.925746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc28aa0-ebb8-4a83-b8db-29ca3d528355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:01.926001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339657-79b7-49b2-8d6d-f078b6967734 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.926387 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339657-79b7-49b2-8d6d-f078b6967734 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.926808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339657-79b7-49b2-8d6d-f078b6967734 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.927193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc28aa0-ebb8-4a83-b8db-29ca3d528355 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:01.928502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 95/181] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:01.929313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339657-79b7-49b2-8d6d-f078b6967734 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:01.937159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 87/182] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:01 2022] GET /identity/v3/role_assignments?user.id=c765c31c0c1d406383a20f8e12957d4e&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:01.938400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50797-df65-4f94-84ec-9b10689038d9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:01.938692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50797-df65-4f94-84ec-9b10689038d9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:01.938968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50797-df65-4f94-84ec-9b10689038d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:01.978131 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-22c50797-df65-4f94-84ec-9b10689038d9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:01.979386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-22c50797-df65-4f94-84ec-9b10689038d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:02.119154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 88/183] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:02.120742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11173a-dc2e-4d31-8010-48635c01eec2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.121287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11173a-dc2e-4d31-8010-48635c01eec2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.121703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11173a-dc2e-4d31-8010-48635c01eec2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.123456 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 89/184] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:02.129918 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d4c17-f701-467e-9dac-2b9c825cef59 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.130559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d4c17-f701-467e-9dac-2b9c825cef59 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.131542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d4c17-f701-467e-9dac-2b9c825cef59 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.133499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 90/185] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:02.134796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b975c4-3a4a-4080-a7dd-828ba54a6d24 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.135243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b975c4-3a4a-4080-a7dd-828ba54a6d24 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.135731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b975c4-3a4a-4080-a7dd-828ba54a6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.137778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339657-79b7-49b2-8d6d-f078b6967734 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:02.155974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-38b975c4-3a4a-4080-a7dd-828ba54a6d24 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:02.157588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-38b975c4-3a4a-4080-a7dd-828ba54a6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:02.160431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:02.167769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:02.202309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658b056-78c7-4aba-a5c6-030e380761e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:02.202985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b056-78c7-4aba-a5c6-030e380761e5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.203399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b056-78c7-4aba-a5c6-030e380761e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.203793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658b056-78c7-4aba-a5c6-030e380761e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.204668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b056-78c7-4aba-a5c6-030e380761e5 None admin] RBAC: Adding query filter params (role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=2ccb98feecd34c67a6acb4db9d5c724e, user.id=f259ec9489364c74a1ba8b68ff8cdbb4) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:02.205719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b056-78c7-4aba-a5c6-030e380761e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:02.207374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658b056-78c7-4aba-a5c6-030e380761e5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:02.214015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 96/186] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:01 2022] GET /identity/v3/role_assignments?user.id=f259ec9489364c74a1ba8b68ff8cdbb4&scope.project.id=2ccb98feecd34c67a6acb4db9d5c724e&role.id=51dbfe81239845968f102b6b956c7061 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:02.215523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcba72c-fd6d-4363-9cb3-b66b0f99f82c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.215979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcba72c-fd6d-4363-9cb3-b66b0f99f82c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.216491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcba72c-fd6d-4363-9cb3-b66b0f99f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.239393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 91/187] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:02.250398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6fcba72c-fd6d-4363-9cb3-b66b0f99f82c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:02.251793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6fcba72c-fd6d-4363-9cb3-b66b0f99f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:02.342414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b975c4-3a4a-4080-a7dd-828ba54a6d24 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:02.359805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 97/188] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:02.436686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcba72c-fd6d-4363-9cb3-b66b0f99f82c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:02.458996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b975c4-3a4a-4080-a7dd-828ba54a6d24 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:02.498600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3144-896a-413c-9a41-678dcad2d48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:02.499237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3144-896a-413c-9a41-678dcad2d48b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.499784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3144-896a-413c-9a41-678dcad2d48b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.500054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3144-896a-413c-9a41-678dcad2d48b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.509217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:02.513782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab3144-896a-413c-9a41-678dcad2d48b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-93ab3144-896a-413c-9a41-678dcad2d48b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:02.519225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:02.520129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:02.521377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 92/189] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:02.527422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3144-896a-413c-9a41-678dcad2d48b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:02.586672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcba72c-fd6d-4363-9cb3-b66b0f99f82c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:02.596949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:02.633560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba2903-0feb-4222-b680-3f5ec80deb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:02.634359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba2903-0feb-4222-b680-3f5ec80deb95 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.634923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba2903-0feb-4222-b680-3f5ec80deb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.635210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba2903-0feb-4222-b680-3f5ec80deb95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.636330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba2903-0feb-4222-b680-3f5ec80deb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:02.638287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba2903-0feb-4222-b680-3f5ec80deb95 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:02.640290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 98/190] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:02.641085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba2903-0feb-4222-b680-3f5ec80deb95 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:02.652788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3144-896a-413c-9a41-678dcad2d48b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:02.694779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:02.695387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.695665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.696216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.696588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:02.696890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:02.698293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:02.707533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 93/191] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:02.708130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:02.753796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba2903-0feb-4222-b680-3f5ec80deb95 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:02.765567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:02.787546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab28037-0594-49e1-9daa-eeb4277030d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:02.788180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28037-0594-49e1-9daa-eeb4277030d4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.788484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28037-0594-49e1-9daa-eeb4277030d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.788765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28037-0594-49e1-9daa-eeb4277030d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.798639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab28037-0594-49e1-9daa-eeb4277030d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9ab28037-0594-49e1-9daa-eeb4277030d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:02.803547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:02.804439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 99/192] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:02.809847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab28037-0594-49e1-9daa-eeb4277030d4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:02.810572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a248be-7e63-4d3a-a37d-ce2a64e774f6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:02.843152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927a8b1-a4b5-4cd3-8598-9cd6f2ea6a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:02.843754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a8b1-a4b5-4cd3-8598-9cd6f2ea6a5e None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.844031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a8b1-a4b5-4cd3-8598-9cd6f2ea6a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.844299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a8b1-a4b5-4cd3-8598-9cd6f2ea6a5e None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.844709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:02.844943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927a8b1-a4b5-4cd3-8598-9cd6f2ea6a5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:02.846590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927a8b1-a4b5-4cd3-8598-9cd6f2ea6a5e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:02.867387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 94/193] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:02 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:02.868306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927a8b1-a4b5-4cd3-8598-9cd6f2ea6a5e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:02.930891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab28037-0594-49e1-9daa-eeb4277030d4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:02.968401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178aa9d-0d66-4105-a5fe-08e1dcdedba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:02.969151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178aa9d-0d66-4105-a5fe-08e1dcdedba0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:02.969435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178aa9d-0d66-4105-a5fe-08e1dcdedba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:02.969766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178aa9d-0d66-4105-a5fe-08e1dcdedba0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:02.981400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178aa9d-0d66-4105-a5fe-08e1dcdedba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:02.983706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927a8b1-a4b5-4cd3-8598-9cd6f2ea6a5e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-a178aa9d-0d66-4105-a5fe-08e1dcdedba0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:02.986885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:02.987827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:02.988632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 100/194] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:02.989359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178aa9d-0d66-4105-a5fe-08e1dcdedba0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.001835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:03.024337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb4320-dfd7-4b5c-a699-534a3f9e4c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.025179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4320-dfd7-4b5c-a699-534a3f9e4c4b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.025571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4320-dfd7-4b5c-a699-534a3f9e4c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.025916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4320-dfd7-4b5c-a699-534a3f9e4c4b None admin] PATH_INFO: `/v3/users/8495f29e71924549a66c06c12275c58f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.042887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb4320-dfd7-4b5c-a699-534a3f9e4c4b None admin] RBAC: Authorizing `identity:get_user(user_id=8495f29e71924549a66c06c12275c58f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.044664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb4320-dfd7-4b5c-a699-534a3f9e4c4b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.046161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 95/195] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:02 2022] GET /identity/v3/users/8495f29e71924549a66c06c12275c58f => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:03.046861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb4320-dfd7-4b5c-a699-534a3f9e4c4b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.097770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:03.105859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178aa9d-0d66-4105-a5fe-08e1dcdedba0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.148378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.149232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.149370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.150181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.150430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:03.150688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.152166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.162497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 101/196] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:03.162790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.180127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb4320-dfd7-4b5c-a699-534a3f9e4c4b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.226494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.227117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.227398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.227734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.228590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:03.229271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.230661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.240471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 96/197] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:03.241912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.287611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e64cde-3c1d-4436-a45a-49c21e05225f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.291480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:03.332413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e5ee7-377d-48a8-8970-cda608f8a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.333576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5ee7-377d-48a8-8970-cda608f8a0cd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.333855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5ee7-377d-48a8-8970-cda608f8a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.334127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5ee7-377d-48a8-8970-cda608f8a0cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.359763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2effc21-3210-480f-91b8-154efcd2a76a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.369168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:03.398120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb318ed-cf31-4478-810c-8dd6f4e697f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.398849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb318ed-cf31-4478-810c-8dd6f4e697f8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.399147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb318ed-cf31-4478-810c-8dd6f4e697f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.399426 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb318ed-cf31-4478-810c-8dd6f4e697f8 None admin] PATH_INFO: `/v3/users/8495f29e71924549a66c06c12275c58f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.400581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb318ed-cf31-4478-810c-8dd6f4e697f8 None admin] RBAC: Authorizing `identity:get_user(user_id=8495f29e71924549a66c06c12275c58f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.402095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb318ed-cf31-4478-810c-8dd6f4e697f8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.403981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 97/198] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/users/8495f29e71924549a66c06c12275c58f => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:03.404797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb318ed-cf31-4478-810c-8dd6f4e697f8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.430110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e5ee7-377d-48a8-8970-cda608f8a0cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.431954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e5ee7-377d-48a8-8970-cda608f8a0cd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.516540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb318ed-cf31-4478-810c-8dd6f4e697f8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.519078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:03.554657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b43f6-d597-4983-b292-f3f54ab41318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.555459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b43f6-d597-4983-b292-f3f54ab41318 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.555855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b43f6-d597-4983-b292-f3f54ab41318 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.556218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b43f6-d597-4983-b292-f3f54ab41318 None admin] PATH_INFO: `/v3/users/35679996b94b422092fb4b6a4e9d61f4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.558010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b43f6-d597-4983-b292-f3f54ab41318 None admin] RBAC: Authorizing `identity:get_user(user_id=35679996b94b422092fb4b6a4e9d61f4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.559281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b43f6-d597-4983-b292-f3f54ab41318 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.561164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 98/199] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/users/35679996b94b422092fb4b6a4e9d61f4 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:03.562184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b43f6-d597-4983-b292-f3f54ab41318 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.566627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 102/200] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:03.568923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e5ee7-377d-48a8-8970-cda608f8a0cd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.642760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:03.675270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b43f6-d597-4983-b292-f3f54ab41318 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.699073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e5ee7-377d-48a8-8970-cda608f8a0cd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:03.717447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2c2f6-be9a-4505-b777-9b4f33efb9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.718391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2c2f6-be9a-4505-b777-9b4f33efb9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.718890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2c2f6-be9a-4505-b777-9b4f33efb9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.719364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2c2f6-be9a-4505-b777-9b4f33efb9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.734471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e118314-9ddc-468e-b1d1-9804a82b167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:03.735173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e118314-9ddc-468e-b1d1-9804a82b167c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:03.735525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e118314-9ddc-468e-b1d1-9804a82b167c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:03.735889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e118314-9ddc-468e-b1d1-9804a82b167c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:03.775158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:03.818735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2c2f6-be9a-4505-b777-9b4f33efb9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.820100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e118314-9ddc-468e-b1d1-9804a82b167c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:03.821302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2c2f6-be9a-4505-b777-9b4f33efb9e9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.821742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e118314-9ddc-468e-b1d1-9804a82b167c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:03.879231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:03.925964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 103/201] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:03.926721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e118314-9ddc-468e-b1d1-9804a82b167c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:03.945607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 99/202] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:03.946715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2c2f6-be9a-4505-b777-9b4f33efb9e9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:04.024554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:04.040375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e118314-9ddc-468e-b1d1-9804a82b167c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:04.057489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2c2f6-be9a-4505-b777-9b4f33efb9e9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:04.075285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fe1ae-9d3d-4487-9406-f13d87c9f6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:04.075818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fe1ae-9d3d-4487-9406-f13d87c9f6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:04.076167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fe1ae-9d3d-4487-9406-f13d87c9f6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:04.076511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fe1ae-9d3d-4487-9406-f13d87c9f6c8 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:04.077723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fe1ae-9d3d-4487-9406-f13d87c9f6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:04.079334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fe1ae-9d3d-4487-9406-f13d87c9f6c8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:04.081902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 104/203] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:04.082836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fe1ae-9d3d-4487-9406-f13d87c9f6c8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:04.094877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75218a22-e1f0-4bd8-ada3-399918507b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:04.095737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75218a22-e1f0-4bd8-ada3-399918507b4c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:04.096763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75218a22-e1f0-4bd8-ada3-399918507b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:04.097241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75218a22-e1f0-4bd8-ada3-399918507b4c None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:04.098759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75218a22-e1f0-4bd8-ada3-399918507b4c None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:04.100404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75218a22-e1f0-4bd8-ada3-399918507b4c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:04.102732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 100/204] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:03 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:04.103682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75218a22-e1f0-4bd8-ada3-399918507b4c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:04.108600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:04.186790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fe1ae-9d3d-4487-9406-f13d87c9f6c8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:04.209673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75218a22-e1f0-4bd8-ada3-399918507b4c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:04.222850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2aa152-3757-4bd0-9b35-675e79bde076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:04.223605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2aa152-3757-4bd0-9b35-675e79bde076 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:04.223955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2aa152-3757-4bd0-9b35-675e79bde076 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:04.224460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2aa152-3757-4bd0-9b35-675e79bde076 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:04.226025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2aa152-3757-4bd0-9b35-675e79bde076 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:04.227800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2aa152-3757-4bd0-9b35-675e79bde076 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:04.230125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 105/205] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:04 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:04.233544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2aa152-3757-4bd0-9b35-675e79bde076 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:04.254727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:04.255688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:04.256038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:04.256859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:04.257724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=94affdd6cbf542aa881f7f689c9d1251, user.id=8495f29e71924549a66c06c12275c58f) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:04.258104 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:04.259618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:04.268188 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 101/206] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:04 2022] GET /identity/v3/role_assignments?user.id=8495f29e71924549a66c06c12275c58f&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:04.269334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:04.273976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:04.355506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:04.375602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2aa152-3757-4bd0-9b35-675e79bde076 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:04.415099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcafb63-6146-4b44-bd2e-a16c9b2c2d28 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:04.438878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a612c2-f275-4745-b49f-2f4f71901ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:04.439522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a612c2-f275-4745-b49f-2f4f71901ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:04.440344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a612c2-f275-4745-b49f-2f4f71901ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:04.440615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a612c2-f275-4745-b49f-2f4f71901ca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:04.441402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a612c2-f275-4745-b49f-2f4f71901ca4 None admin] RBAC: Adding query filter params (role.id=26eaaf4903bb4dd1a32f47236b451b7d, scope.project.id=0229e1f6c84e43d0ab052db94ab62329, user.id=35679996b94b422092fb4b6a4e9d61f4) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:04.441705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a612c2-f275-4745-b49f-2f4f71901ca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:04.443177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a612c2-f275-4745-b49f-2f4f71901ca4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:04.454456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 106/207] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:04 2022] GET /identity/v3/role_assignments?user.id=35679996b94b422092fb4b6a4e9d61f4&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=26eaaf4903bb4dd1a32f47236b451b7d => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:04.456380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e4aa8-c952-4a1f-ab5e-1f954f8124f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:04.457160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4aa8-c952-4a1f-ab5e-1f954f8124f8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:04.457448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4aa8-c952-4a1f-ab5e-1f954f8124f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:04.457723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4aa8-c952-4a1f-ab5e-1f954f8124f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:04.458490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4aa8-c952-4a1f-ab5e-1f954f8124f8 None admin] RBAC: Adding query filter params (role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=94affdd6cbf542aa881f7f689c9d1251, user.id=8495f29e71924549a66c06c12275c58f) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:04.458808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4aa8-c952-4a1f-ab5e-1f954f8124f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:04.460329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4aa8-c952-4a1f-ab5e-1f954f8124f8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:04.467195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 102/208] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:04 2022] GET /identity/v3/role_assignments?user.id=8495f29e71924549a66c06c12275c58f&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:05.307221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fef69-8633-43dd-b53c-94719ca123e1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.307730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fef69-8633-43dd-b53c-94719ca123e1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.307835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fef69-8633-43dd-b53c-94719ca123e1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.309145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 107/209] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:05.314454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74a8f-f8c0-4bfd-b1bf-e281d1fbc5cf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.315372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74a8f-f8c0-4bfd-b1bf-e281d1fbc5cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.315538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a74a8f-f8c0-4bfd-b1bf-e281d1fbc5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.334512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e2a74a8f-f8c0-4bfd-b1bf-e281d1fbc5cf None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:05.335715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e2a74a8f-f8c0-4bfd-b1bf-e281d1fbc5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:05.393700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ab58-96db-4801-9e48-24129bb2d137 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.394020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ab58-96db-4801-9e48-24129bb2d137 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.394249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ab58-96db-4801-9e48-24129bb2d137 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.395725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 108/210] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:05.401416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbabf23-dcf1-4185-8ddf-10e849dbafc4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.401713 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbabf23-dcf1-4185-8ddf-10e849dbafc4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.401993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbabf23-dcf1-4185-8ddf-10e849dbafc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.409301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:05.415317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 103/211] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:05.430823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3cbabf23-dcf1-4185-8ddf-10e849dbafc4 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:05.432038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3cbabf23-dcf1-4185-8ddf-10e849dbafc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:05.503066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 109/212] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:05.692035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a74a8f-f8c0-4bfd-b1bf-e281d1fbc5cf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:05.795516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a74a8f-f8c0-4bfd-b1bf-e281d1fbc5cf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:05.795889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbabf23-dcf1-4185-8ddf-10e849dbafc4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:05.832716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d88b3-6386-4c85-aa52-99d48b84f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:05.833468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d88b3-6386-4c85-aa52-99d48b84f372 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.833818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d88b3-6386-4c85-aa52-99d48b84f372 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.834163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d88b3-6386-4c85-aa52-99d48b84f372 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.845601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d88b3-6386-4c85-aa52-99d48b84f372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-062d88b3-6386-4c85-aa52-99d48b84f372 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:05.851110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:05.852007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:05.852825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 104/213] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:05.859748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d88b3-6386-4c85-aa52-99d48b84f372 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:05.901149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:05.917210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbabf23-dcf1-4185-8ddf-10e849dbafc4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:05.922006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:05.953504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40f11-500b-4619-a265-37585d5e31c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:05.954055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40f11-500b-4619-a265-37585d5e31c1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:05.954333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40f11-500b-4619-a265-37585d5e31c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:05.954604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b40f11-500b-4619-a265-37585d5e31c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:05.955780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40f11-500b-4619-a265-37585d5e31c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:05.957440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b40f11-500b-4619-a265-37585d5e31c1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:05.959240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 110/214] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:05.964529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40f11-500b-4619-a265-37585d5e31c1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:05.967322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d88b3-6386-4c85-aa52-99d48b84f372 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:06.003278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:06.004184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.004668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.005218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.006107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:06.006624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:06.008298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:06.022043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 105/215] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:06.023235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:06.070127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b40f11-500b-4619-a265-37585d5e31c1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:06.106615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e018c-2900-49d1-9e7f-c3e508cff9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:06.107227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e018c-2900-49d1-9e7f-c3e508cff9c6 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.107513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e018c-2900-49d1-9e7f-c3e508cff9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.107809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e018c-2900-49d1-9e7f-c3e508cff9c6 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.108540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e018c-2900-49d1-9e7f-c3e508cff9c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:06.110112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e018c-2900-49d1-9e7f-c3e508cff9c6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:06.134296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a831e-914f-48cf-b6bb-938add4d5946 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:06.145230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 111/216] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:05 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:46:06.160404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:06.178953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc041-a58f-494b-960e-cf1ab36cef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:06.179970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc041-a58f-494b-960e-cf1ab36cef0c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.180474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc041-a58f-494b-960e-cf1ab36cef0c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.180950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefc041-a58f-494b-960e-cf1ab36cef0c None admin] PATH_INFO: `/v3/users/aa2219957a9646e692ba5107ccba4e27` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.198816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc041-a58f-494b-960e-cf1ab36cef0c None admin] RBAC: Authorizing `identity:get_user(user_id=aa2219957a9646e692ba5107ccba4e27)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:06.200764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefc041-a58f-494b-960e-cf1ab36cef0c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:06.202963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 106/217] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:06 2022] GET /identity/v3/users/aa2219957a9646e692ba5107ccba4e27 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:06.211604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e018c-2900-49d1-9e7f-c3e508cff9c6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:06.228225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:06.333317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e018c-2900-49d1-9e7f-c3e508cff9c6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:06.370814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12a665-841b-43af-808d-0e49b71511b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:06.371807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a665-841b-43af-808d-0e49b71511b4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.372351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a665-841b-43af-808d-0e49b71511b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.372824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a665-841b-43af-808d-0e49b71511b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.444541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12a665-841b-43af-808d-0e49b71511b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:06.446347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12a665-841b-43af-808d-0e49b71511b4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:06.459495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:06.563966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 112/218] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:06.570280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc041-a58f-494b-960e-cf1ab36cef0c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:06.687614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefc041-a58f-494b-960e-cf1ab36cef0c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:06.717291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f58b84-a65d-46f1-a91d-b997c21844ed None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.717938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f58b84-a65d-46f1-a91d-b997c21844ed None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.718406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f58b84-a65d-46f1-a91d-b997c21844ed None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.719947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 113/219] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:06.725331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133795e1-f1a7-4f61-a564-930009e4e497 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.725616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133795e1-f1a7-4f61-a564-930009e4e497 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.725895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133795e1-f1a7-4f61-a564-930009e4e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.731851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaeb0b7-904e-41cd-ae35-e0d7cb3beb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:06.732827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb0b7-904e-41cd-ae35-e0d7cb3beb07 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.733351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb0b7-904e-41cd-ae35-e0d7cb3beb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.733965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb0b7-904e-41cd-ae35-e0d7cb3beb07 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.735332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaeb0b7-904e-41cd-ae35-e0d7cb3beb07 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:06.737107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaeb0b7-904e-41cd-ae35-e0d7cb3beb07 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:06.739255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 107/220] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:06 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:06.744795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-133795e1-f1a7-4f61-a564-930009e4e497 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:06.745359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaeb0b7-904e-41cd-ae35-e0d7cb3beb07 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:06.746009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-133795e1-f1a7-4f61-a564-930009e4e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:06.799832 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:06.843854 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 114/221] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:06.853025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09995-4119-4c83-9e27-04be27de10d4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.853025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09995-4119-4c83-9e27-04be27de10d4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.853025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe09995-4119-4c83-9e27-04be27de10d4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.853025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 115/222] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:06.853025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff534-d037-4cc8-a209-cb3abe4df59e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.853025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff534-d037-4cc8-a209-cb3abe4df59e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.853504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ff534-d037-4cc8-a209-cb3abe4df59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.876095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1d3ff534-d037-4cc8-a209-cb3abe4df59e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:06.878762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1d3ff534-d037-4cc8-a209-cb3abe4df59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:06.885793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaeb0b7-904e-41cd-ae35-e0d7cb3beb07 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:06.922157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:06.958774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:06.959336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 116/223] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:06.960090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:06.960573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:06.961073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:06.962026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] RBAC: Adding query filter params (role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=94affdd6cbf542aa881f7f689c9d1251, user.id=aa2219957a9646e692ba5107ccba4e27) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:06.962536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:06.964168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:06.977099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 108/224] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:06 2022] GET /identity/v3/role_assignments?user.id=aa2219957a9646e692ba5107ccba4e27&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=51dbfe81239845968f102b6b956c7061 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:07.192132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ff534-d037-4cc8-a209-cb3abe4df59e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:07.326267 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ff534-d037-4cc8-a209-cb3abe4df59e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:07.361634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37867-9e72-4634-b229-0824923fe199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:07.362906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37867-9e72-4634-b229-0824923fe199 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:07.363072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37867-9e72-4634-b229-0824923fe199 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:07.368994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c37867-9e72-4634-b229-0824923fe199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:07.378223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c37867-9e72-4634-b229-0824923fe199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-76c37867-9e72-4634-b229-0824923fe199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:07.383236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:07.384137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:07.384957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 117/225] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:07.391929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:07.543518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f85eb-8341-4054-94c1-66c84cc0fb32 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:07.555072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:07.582533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37867-9e72-4634-b229-0824923fe199 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:07.591220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:07.591837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:07.592125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:07.592409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:07.593086 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:07.593392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:07.594854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:07.621520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:07.623548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 109/226] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:07.631267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:07.704735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c37867-9e72-4634-b229-0824923fe199 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:07.743765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52834a-0711-41a1-9de3-bff4f3dc4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:07.744752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52834a-0711-41a1-9de3-bff4f3dc4891 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:07.745192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52834a-0711-41a1-9de3-bff4f3dc4891 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:07.745566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52834a-0711-41a1-9de3-bff4f3dc4891 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:07.757391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e52834a-0711-41a1-9de3-bff4f3dc4891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5e52834a-0711-41a1-9de3-bff4f3dc4891 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:07.762747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:07.763839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:07.764862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:07.766845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 118/227] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:07.773267 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52834a-0711-41a1-9de3-bff4f3dc4891 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:07.841942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b764b-8226-479c-9ab2-6096d94c61f9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:07.883558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5d9e-3aba-49ab-93ee-ea934ea1768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:07.885622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5d9e-3aba-49ab-93ee-ea934ea1768d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:07.885906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5d9e-3aba-49ab-93ee-ea934ea1768d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:07.886177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5d9e-3aba-49ab-93ee-ea934ea1768d None admin] PATH_INFO: `/v3/users/8495f29e71924549a66c06c12275c58f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:07.889770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d5d9e-3aba-49ab-93ee-ea934ea1768d None admin] RBAC: Authorizing `identity:get_user(user_id=8495f29e71924549a66c06c12275c58f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:07.891215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d5d9e-3aba-49ab-93ee-ea934ea1768d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:07.892809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 110/228] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:07 2022] GET /identity/v3/users/8495f29e71924549a66c06c12275c58f => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:07.914282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5d9e-3aba-49ab-93ee-ea934ea1768d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:07.976332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:07.996571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:07.999456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e52834a-0711-41a1-9de3-bff4f3dc4891 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:08.064217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:08.065378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.065657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.065924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.066577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:08.066879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:08.068249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:08.091054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 119/229] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:08.103105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5d9e-3aba-49ab-93ee-ea934ea1768d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:08.113033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:08.164469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a52e2-6e3e-4fdd-8726-e67f2ed23143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:08.165139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a52e2-6e3e-4fdd-8726-e67f2ed23143 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.165467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a52e2-6e3e-4fdd-8726-e67f2ed23143 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.165747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a52e2-6e3e-4fdd-8726-e67f2ed23143 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.169728 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a52e2-6e3e-4fdd-8726-e67f2ed23143 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:08.171241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a52e2-6e3e-4fdd-8726-e67f2ed23143 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:08.172875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 111/230] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:07 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:08.179327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a52e2-6e3e-4fdd-8726-e67f2ed23143 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:08.281039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd91616-5920-4a1c-9ae9-a4314a2cc29b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:08.354286 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a52e2-6e3e-4fdd-8726-e67f2ed23143 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:08.364100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63780e-ad6a-4bfa-9fb7-87c67adaaf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:08.364753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63780e-ad6a-4bfa-9fb7-87c67adaaf84 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.365049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63780e-ad6a-4bfa-9fb7-87c67adaaf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.365329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63780e-ad6a-4bfa-9fb7-87c67adaaf84 None admin] PATH_INFO: `/v3/users/8495f29e71924549a66c06c12275c58f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.366497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63780e-ad6a-4bfa-9fb7-87c67adaaf84 None admin] RBAC: Authorizing `identity:get_user(user_id=8495f29e71924549a66c06c12275c58f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:08.367958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63780e-ad6a-4bfa-9fb7-87c67adaaf84 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:08.369885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 120/231] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:08 2022] GET /identity/v3/users/8495f29e71924549a66c06c12275c58f => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:08.373902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:08.379514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63780e-ad6a-4bfa-9fb7-87c67adaaf84 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:08.420158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:08.421618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec8697-368c-47a5-a1c6-3b1c063517ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:08.422366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec8697-368c-47a5-a1c6-3b1c063517ff None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.423787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec8697-368c-47a5-a1c6-3b1c063517ff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.424072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec8697-368c-47a5-a1c6-3b1c063517ff None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251/users/8495f29e71924549a66c06c12275c58f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.428657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec8697-368c-47a5-a1c6-3b1c063517ff None admin] RBAC: Authorizing `identity:create_grant(project_id=94affdd6cbf542aa881f7f689c9d1251, user_id=8495f29e71924549a66c06c12275c58f, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:08.430813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec8697-368c-47a5-a1c6-3b1c063517ff None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:08.454154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 112/232] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:08 2022] PUT /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251/users/8495f29e71924549a66c06c12275c58f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:46:08.528874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63780e-ad6a-4bfa-9fb7-87c67adaaf84 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:08.583286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc37d3-8ae5-4ce2-815e-75f0cc961050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:08.583949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc37d3-8ae5-4ce2-815e-75f0cc961050 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.584237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc37d3-8ae5-4ce2-815e-75f0cc961050 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.584510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc37d3-8ae5-4ce2-815e-75f0cc961050 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.585732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc37d3-8ae5-4ce2-815e-75f0cc961050 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:08.587223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc37d3-8ae5-4ce2-815e-75f0cc961050 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:08.588920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 121/233] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:08 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:08.598060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec8697-368c-47a5-a1c6-3b1c063517ff None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:08.754992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec8697-368c-47a5-a1c6-3b1c063517ff None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:08.793923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3444600-f6c8-4fec-8a07-55ce0f9b4bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:08.794628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444600-f6c8-4fec-8a07-55ce0f9b4bbe None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.794916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444600-f6c8-4fec-8a07-55ce0f9b4bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.795193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3444600-f6c8-4fec-8a07-55ce0f9b4bbe None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251/users/8495f29e71924549a66c06c12275c58f/roles/6c35be71800f4fd791345d48ca3f6ed2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.797389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3444600-f6c8-4fec-8a07-55ce0f9b4bbe None admin] RBAC: Authorizing `identity:create_grant(project_id=94affdd6cbf542aa881f7f689c9d1251, user_id=8495f29e71924549a66c06c12275c58f, role_id=6c35be71800f4fd791345d48ca3f6ed2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:08.798886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3444600-f6c8-4fec-8a07-55ce0f9b4bbe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:08.823661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 113/234] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:08 2022] PUT /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251/users/8495f29e71924549a66c06c12275c58f/roles/6c35be71800f4fd791345d48ca3f6ed2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:08.902248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825357a2-4b77-4d63-879a-841b63104e5a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.902596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825357a2-4b77-4d63-879a-841b63104e5a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.903039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825357a2-4b77-4d63-879a-841b63104e5a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.904578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 122/235] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:08.913221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce277633-e383-4457-9cc7-4a7146344056 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:08.913557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce277633-e383-4457-9cc7-4a7146344056 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:08.913842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce277633-e383-4457-9cc7-4a7146344056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:08.940374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ce277633-e383-4457-9cc7-4a7146344056 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:08.941647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce277633-e383-4457-9cc7-4a7146344056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:08.967646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.018787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 114/236] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:09.054204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a0766-4a5a-4920-a539-214023f522a3 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.054815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a0766-4a5a-4920-a539-214023f522a3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.055293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a0766-4a5a-4920-a539-214023f522a3 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.056843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 123/237] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:09.062824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fbd3-90ac-4e30-a8c8-a939f2e36b66 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.063113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fbd3-90ac-4e30-a8c8-a939f2e36b66 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.063395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fbd3-90ac-4e30-a8c8-a939f2e36b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.081988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fcd0fbd3-90ac-4e30-a8c8-a939f2e36b66 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:09.083282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fcd0fbd3-90ac-4e30-a8c8-a939f2e36b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:09.166070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 115/238] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:09.313571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a0766-4a5a-4920-a539-214023f522a3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.490469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.529929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a0766-4a5a-4920-a539-214023f522a3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.554738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334734cf-6595-49ae-a957-59cc1c701a34 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.555349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334734cf-6595-49ae-a957-59cc1c701a34 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.555821 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334734cf-6595-49ae-a957-59cc1c701a34 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.557577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 116/239] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:09.562695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fe63-1ad9-4d41-9745-0c615cb9aef0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.563219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fe63-1ad9-4d41-9745-0c615cb9aef0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.563748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4fe63-1ad9-4d41-9745-0c615cb9aef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.602859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-58e4fe63-1ad9-4d41-9745-0c615cb9aef0 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:09.604937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-58e4fe63-1ad9-4d41-9745-0c615cb9aef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:09.609299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8519c-c4aa-4006-bd8e-9578e9862400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.609943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8519c-c4aa-4006-bd8e-9578e9862400 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.610220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8519c-c4aa-4006-bd8e-9578e9862400 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.610492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8519c-c4aa-4006-bd8e-9578e9862400 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.621872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8519c-c4aa-4006-bd8e-9578e9862400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:09.623421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8519c-c4aa-4006-bd8e-9578e9862400 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:09.625708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 124/240] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:09.629917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8519c-c4aa-4006-bd8e-9578e9862400 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.705645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 117/241] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:09.730029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4fe63-1ad9-4d41-9745-0c615cb9aef0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.779132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:09.872729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8519c-c4aa-4006-bd8e-9578e9862400 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.930369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf4af2-a16b-416d-9c4d-2e7d78d626af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:09.931262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4af2-a16b-416d-9c4d-2e7d78d626af None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:09.931710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4af2-a16b-416d-9c4d-2e7d78d626af None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:09.932125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf4af2-a16b-416d-9c4d-2e7d78d626af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:09.939703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4fe63-1ad9-4d41-9745-0c615cb9aef0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:09.945542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf4af2-a16b-416d-9c4d-2e7d78d626af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-18bf4af2-a16b-416d-9c4d-2e7d78d626af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:09.952232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:09.953353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:09.954362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:09.956897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 125/242] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:09.963404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf4af2-a16b-416d-9c4d-2e7d78d626af None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:09.984047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:10.021018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e182bd-9f0d-4f27-acdb-9dec79a8be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.021628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e182bd-9f0d-4f27-acdb-9dec79a8be1c None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.021909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e182bd-9f0d-4f27-acdb-9dec79a8be1c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.022177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e182bd-9f0d-4f27-acdb-9dec79a8be1c None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.022830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e182bd-9f0d-4f27-acdb-9dec79a8be1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.024257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e182bd-9f0d-4f27-acdb-9dec79a8be1c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.055695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 118/243] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:09 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:10.056632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e182bd-9f0d-4f27-acdb-9dec79a8be1c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.081803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf4af2-a16b-416d-9c4d-2e7d78d626af None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.122263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.123253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.123702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.124120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.124950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:10.125692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.127490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.136875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 126/244] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:10.142939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.149361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:10.180335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e182bd-9f0d-4f27-acdb-9dec79a8be1c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.218338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f54b-0f49-4abd-958d-02e55aecdfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.218983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f54b-0f49-4abd-958d-02e55aecdfa6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.219268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f54b-0f49-4abd-958d-02e55aecdfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.219544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77f54b-0f49-4abd-958d-02e55aecdfa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.233228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77f54b-0f49-4abd-958d-02e55aecdfa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:10.238010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-dc77f54b-0f49-4abd-958d-02e55aecdfa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:10.240479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:10.242017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:10.242887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 119/245] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:10.248743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f54b-0f49-4abd-958d-02e55aecdfa6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.280606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235fc5-ea7c-439f-83a2-e8e34e8c20c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.325313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81efe5-686f-4270-93fc-62f15b80c0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.326552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81efe5-686f-4270-93fc-62f15b80c0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.327085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81efe5-686f-4270-93fc-62f15b80c0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.327572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81efe5-686f-4270-93fc-62f15b80c0b7 None admin] PATH_INFO: `/v3/users/8f5d50b350e54f24a4bb2f9d2d51340e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.344332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81efe5-686f-4270-93fc-62f15b80c0b7 None admin] RBAC: Authorizing `identity:get_user(user_id=8f5d50b350e54f24a4bb2f9d2d51340e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.346376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81efe5-686f-4270-93fc-62f15b80c0b7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.348647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 127/246] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:10 2022] GET /identity/v3/users/8f5d50b350e54f24a4bb2f9d2d51340e => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:10.354472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81efe5-686f-4270-93fc-62f15b80c0b7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.359175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77f54b-0f49-4abd-958d-02e55aecdfa6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.395120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.395732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.396006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.396280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.396937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:10.397286 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.398653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.400015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:10.407954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 120/247] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:10.414247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.468560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81efe5-686f-4270-93fc-62f15b80c0b7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.505929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cea2d-7166-44c9-bfb6-c45031de99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.507499 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cea2d-7166-44c9-bfb6-c45031de99e6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.508033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cea2d-7166-44c9-bfb6-c45031de99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.508507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cea2d-7166-44c9-bfb6-c45031de99e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.512592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:10.529599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033c5c6-e09b-4e18-9e5a-3dfd169e4a53 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.567147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e20ac-ab12-4a01-a5ad-3db772c6c5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.567778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e20ac-ab12-4a01-a5ad-3db772c6c5ee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.568052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e20ac-ab12-4a01-a5ad-3db772c6c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.568321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e20ac-ab12-4a01-a5ad-3db772c6c5ee None admin] PATH_INFO: `/v3/users/aa2219957a9646e692ba5107ccba4e27` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.569464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e20ac-ab12-4a01-a5ad-3db772c6c5ee None admin] RBAC: Authorizing `identity:get_user(user_id=aa2219957a9646e692ba5107ccba4e27)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.571008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e20ac-ab12-4a01-a5ad-3db772c6c5ee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.572727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 121/248] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:10 2022] GET /identity/v3/users/aa2219957a9646e692ba5107ccba4e27 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:10.578431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e20ac-ab12-4a01-a5ad-3db772c6c5ee None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.592037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cea2d-7166-44c9-bfb6-c45031de99e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.593885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cea2d-7166-44c9-bfb6-c45031de99e6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.644487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:10.704812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e20ac-ab12-4a01-a5ad-3db772c6c5ee None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.735135 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 128/249] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:10.741383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cea2d-7166-44c9-bfb6-c45031de99e6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.745842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab034e2b-6f85-4684-921c-1c893c20cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.746732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034e2b-6f85-4684-921c-1c893c20cd27 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.747262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034e2b-6f85-4684-921c-1c893c20cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.747738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab034e2b-6f85-4684-921c-1c893c20cd27 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.749110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab034e2b-6f85-4684-921c-1c893c20cd27 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.751063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab034e2b-6f85-4684-921c-1c893c20cd27 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.753763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 122/250] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:10 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:10.763183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab034e2b-6f85-4684-921c-1c893c20cd27 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.788538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:10.891010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cea2d-7166-44c9-bfb6-c45031de99e6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.906809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab034e2b-6f85-4684-921c-1c893c20cd27 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:10.941132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd110f-048b-4097-a1f8-a37856339bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.941932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd110f-048b-4097-a1f8-a37856339bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.942534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd110f-048b-4097-a1f8-a37856339bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.942815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd110f-048b-4097-a1f8-a37856339bd8 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.944228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd110f-048b-4097-a1f8-a37856339bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.945824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:10.945937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd110f-048b-4097-a1f8-a37856339bd8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.948789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 129/251] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:10 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:10.956508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7c01f-1a50-4184-b871-1767268c306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:10.957220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c01f-1a50-4184-b871-1767268c306a None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:10.957497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c01f-1a50-4184-b871-1767268c306a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:10.957808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7c01f-1a50-4184-b871-1767268c306a None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251/users/aa2219957a9646e692ba5107ccba4e27/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:10.959905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7c01f-1a50-4184-b871-1767268c306a None admin] RBAC: Authorizing `identity:create_grant(project_id=94affdd6cbf542aa881f7f689c9d1251, user_id=aa2219957a9646e692ba5107ccba4e27, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:10.960467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd110f-048b-4097-a1f8-a37856339bd8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:10.961473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7c01f-1a50-4184-b871-1767268c306a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:10.976262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 123/252] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:10 2022] PUT /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251/users/aa2219957a9646e692ba5107ccba4e27/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:46:11.086073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd110f-048b-4097-a1f8-a37856339bd8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:11.088910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:11.134748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94af49d-cdd9-4b24-954a-05438b3c7d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:11.135697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af49d-cdd9-4b24-954a-05438b3c7d9c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:11.136129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af49d-cdd9-4b24-954a-05438b3c7d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:11.136603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af49d-cdd9-4b24-954a-05438b3c7d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:11.137589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94af49d-cdd9-4b24-954a-05438b3c7d9c None admin] RBAC: Adding query filter params (role.id=26eaaf4903bb4dd1a32f47236b451b7d, scope.project.id=94affdd6cbf542aa881f7f689c9d1251, user.id=8f5d50b350e54f24a4bb2f9d2d51340e) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:11.138050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94af49d-cdd9-4b24-954a-05438b3c7d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:11.139690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94af49d-cdd9-4b24-954a-05438b3c7d9c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:11.146669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 130/253] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:10 2022] GET /identity/v3/role_assignments?user.id=8f5d50b350e54f24a4bb2f9d2d51340e&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=26eaaf4903bb4dd1a32f47236b451b7d => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:11.471232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb4df-26cf-4ccd-b091-78c7f0b12fb6 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:11.472176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb4df-26cf-4ccd-b091-78c7f0b12fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:11.472524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb4df-26cf-4ccd-b091-78c7f0b12fb6 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:11.474184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 124/254] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:11.479475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac08e2a-5d56-4a52-95bc-5cb91cb1c089 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:11.479948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac08e2a-5d56-4a52-95bc-5cb91cb1c089 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:11.480351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac08e2a-5d56-4a52-95bc-5cb91cb1c089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:11.509372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fac08e2a-5d56-4a52-95bc-5cb91cb1c089 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:11.511504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fac08e2a-5d56-4a52-95bc-5cb91cb1c089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:11.606665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 131/255] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:11.646732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4620ae-e05d-495f-83dc-12f73ccaa13f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:11.647232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4620ae-e05d-495f-83dc-12f73ccaa13f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:11.647486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4620ae-e05d-495f-83dc-12f73ccaa13f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:11.649074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 125/256] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:11.663321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd377b-839c-4c6a-aa95-ad19407afcb5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:11.663841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd377b-839c-4c6a-aa95-ad19407afcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:11.664253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd377b-839c-4c6a-aa95-ad19407afcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:11.691724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-11fd377b-839c-4c6a-aa95-ad19407afcb5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:11.697200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11fd377b-839c-4c6a-aa95-ad19407afcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:11.783169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 132/257] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:12.025564 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4620ae-e05d-495f-83dc-12f73ccaa13f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:12.150478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4620ae-e05d-495f-83dc-12f73ccaa13f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:12.194712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62de42-71e6-4f57-ad8f-6f1751fd71e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:12.195354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62de42-71e6-4f57-ad8f-6f1751fd71e0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.195639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62de42-71e6-4f57-ad8f-6f1751fd71e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.195903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62de42-71e6-4f57-ad8f-6f1751fd71e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:12.206798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62de42-71e6-4f57-ad8f-6f1751fd71e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bf62de42-71e6-4f57-ad8f-6f1751fd71e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:12.211648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:12.212567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:12.213392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:12.217085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 126/258] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:12.218592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd377b-839c-4c6a-aa95-ad19407afcb5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:12.249314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62de42-71e6-4f57-ad8f-6f1751fd71e0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:12.265742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:12.336716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:12.406875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62de42-71e6-4f57-ad8f-6f1751fd71e0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:12.422759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd377b-839c-4c6a-aa95-ad19407afcb5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:12.447866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9f6a3-4ea7-4923-876e-b8077f171a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:12.448574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f6a3-4ea7-4923-876e-b8077f171a23 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.448858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f6a3-4ea7-4923-876e-b8077f171a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.449154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f6a3-4ea7-4923-876e-b8077f171a23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:12.461989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9f6a3-4ea7-4923-876e-b8077f171a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-14c9f6a3-4ea7-4923-876e-b8077f171a23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:12.467035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:12.467962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:12.468768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 127/259] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:12.477066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9f6a3-4ea7-4923-876e-b8077f171a23 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:12.502433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:12.503597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.503871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.504135 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:12.504791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:12.505109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:12.512735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:12.531422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 133/260] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:12.536673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:12.606536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9f6a3-4ea7-4923-876e-b8077f171a23 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:12.621445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:12.647216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:12.648735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.649178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.649699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:12.650502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:12.651057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:12.652564 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:12.661204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 128/261] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:12.666974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:12.720414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:12.753110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea43f3-8e53-41e6-9c4f-f3ff9a03983a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:12.832603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12980612-f8fb-4ed8-b564-5c6c9c5a894b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:12.838224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe2ddd-7001-4b4d-9af3-d039361bad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:12.838985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2ddd-7001-4b4d-9af3-d039361bad00 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.839368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2ddd-7001-4b4d-9af3-d039361bad00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.839743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2ddd-7001-4b4d-9af3-d039361bad00 None admin] PATH_INFO: `/v3/users/8495f29e71924549a66c06c12275c58f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:12.841002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe2ddd-7001-4b4d-9af3-d039361bad00 None admin] RBAC: Authorizing `identity:get_user(user_id=8495f29e71924549a66c06c12275c58f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:12.842586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe2ddd-7001-4b4d-9af3-d039361bad00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:12.844473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 134/262] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:12 2022] GET /identity/v3/users/8495f29e71924549a66c06c12275c58f => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:12.849772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe2ddd-7001-4b4d-9af3-d039361bad00 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:12.889700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d44345-6920-4676-9bba-586376620ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:12.890362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44345-6920-4676-9bba-586376620ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.890646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44345-6920-4676-9bba-586376620ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.890925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d44345-6920-4676-9bba-586376620ee0 None admin] PATH_INFO: `/v3/users/8495f29e71924549a66c06c12275c58f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:12.892106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d44345-6920-4676-9bba-586376620ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=8495f29e71924549a66c06c12275c58f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:12.894183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d44345-6920-4676-9bba-586376620ee0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:12.895986 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 129/263] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:12 2022] GET /identity/v3/users/8495f29e71924549a66c06c12275c58f => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:12.901180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d44345-6920-4676-9bba-586376620ee0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:12.959617 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe2ddd-7001-4b4d-9af3-d039361bad00 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:12.995405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be49a5-1b0c-42ce-a6ef-e1ddd06646cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:12.995953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be49a5-1b0c-42ce-a6ef-e1ddd06646cb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:12.996235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be49a5-1b0c-42ce-a6ef-e1ddd06646cb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:12.996505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be49a5-1b0c-42ce-a6ef-e1ddd06646cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.012269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:13.026837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:13.069554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be49a5-1b0c-42ce-a6ef-e1ddd06646cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:13.071041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be49a5-1b0c-42ce-a6ef-e1ddd06646cb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:13.186913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d44345-6920-4676-9bba-586376620ee0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:13.192962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 135/264] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:13.198598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be49a5-1b0c-42ce-a6ef-e1ddd06646cb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:13.258249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:13.268601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325393f7-9613-488e-9a07-4a0cab6ebcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:13.269542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325393f7-9613-488e-9a07-4a0cab6ebcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.270023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325393f7-9613-488e-9a07-4a0cab6ebcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.270483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325393f7-9613-488e-9a07-4a0cab6ebcd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.309006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be49a5-1b0c-42ce-a6ef-e1ddd06646cb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:13.336998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef0b86-ad03-40fa-9efb-0e03a5c58824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:13.337638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef0b86-ad03-40fa-9efb-0e03a5c58824 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.337917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef0b86-ad03-40fa-9efb-0e03a5c58824 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.338190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef0b86-ad03-40fa-9efb-0e03a5c58824 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.339409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef0b86-ad03-40fa-9efb-0e03a5c58824 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:13.342969 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef0b86-ad03-40fa-9efb-0e03a5c58824 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:13.342969 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 136/265] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:13 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:13.349259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef0b86-ad03-40fa-9efb-0e03a5c58824 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:13.382090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325393f7-9613-488e-9a07-4a0cab6ebcd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:13.384111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325393f7-9613-488e-9a07-4a0cab6ebcd8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:13.450187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:13.456004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef0b86-ad03-40fa-9efb-0e03a5c58824 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:13.489746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:13.494632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:13.495494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.495985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.496452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.497397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=94affdd6cbf542aa881f7f689c9d1251, user.id=8495f29e71924549a66c06c12275c58f) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:13.497918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:13.499712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:13.507470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 137/266] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:13 2022] GET /identity/v3/role_assignments?user.id=8495f29e71924549a66c06c12275c58f&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:13.545964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 130/267] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:13.553076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:13.693444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7df088-528f-442f-8783-dbbcdcda4cb6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:13.740146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7574c0-0a28-44d8-a34d-ea9aff533ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:13.741200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7574c0-0a28-44d8-a34d-ea9aff533ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.741698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7574c0-0a28-44d8-a34d-ea9aff533ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.742165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7574c0-0a28-44d8-a34d-ea9aff533ea0 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.743479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7574c0-0a28-44d8-a34d-ea9aff533ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:13.745161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7574c0-0a28-44d8-a34d-ea9aff533ea0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:13.747325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 138/268] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:13 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:13.753802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325393f7-9613-488e-9a07-4a0cab6ebcd8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:13.773298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988d00-8ba8-4590-9fcc-bbc8e59e7154 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.773931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988d00-8ba8-4590-9fcc-bbc8e59e7154 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.774405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988d00-8ba8-4590-9fcc-bbc8e59e7154 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.776156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 139/269] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:13.789997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681fd8-351d-48be-88d8-e5f451ddab02 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.790620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681fd8-351d-48be-88d8-e5f451ddab02 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.791094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23681fd8-351d-48be-88d8-e5f451ddab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.818758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-23681fd8-351d-48be-88d8-e5f451ddab02 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:13.821559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-23681fd8-351d-48be-88d8-e5f451ddab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:13.935861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:13.952031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325393f7-9613-488e-9a07-4a0cab6ebcd8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:13.965743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 140/270] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:13.993364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f5144-7de0-441f-8d20-80a1f7b1b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:13.993989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f5144-7de0-441f-8d20-80a1f7b1b114 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:13.994271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f5144-7de0-441f-8d20-80a1f7b1b114 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:13.994545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f5144-7de0-441f-8d20-80a1f7b1b114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:13.995279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f5144-7de0-441f-8d20-80a1f7b1b114 None admin] RBAC: Adding query filter params (role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=94affdd6cbf542aa881f7f689c9d1251, user.id=8495f29e71924549a66c06c12275c58f) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:13.995585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f5144-7de0-441f-8d20-80a1f7b1b114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:13.997046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f5144-7de0-441f-8d20-80a1f7b1b114 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:14.004955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 131/271] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:13 2022] GET /identity/v3/role_assignments?user.id=8495f29e71924549a66c06c12275c58f&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:14.330527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681fd8-351d-48be-88d8-e5f451ddab02 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.348810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0de2-3c5a-48ea-a42a-66f8f578815a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.349103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0de2-3c5a-48ea-a42a-66f8f578815a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.349341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b0de2-3c5a-48ea-a42a-66f8f578815a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.350728 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 132/272] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:14.356638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668682e-97ca-473f-9a84-294a6b0c88bb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.356938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668682e-97ca-473f-9a84-294a6b0c88bb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.357231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668682e-97ca-473f-9a84-294a6b0c88bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.372591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:14.379518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0668682e-97ca-473f-9a84-294a6b0c88bb None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:14.382219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0668682e-97ca-473f-9a84-294a6b0c88bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:14.465865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23681fd8-351d-48be-88d8-e5f451ddab02 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.480961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 133/273] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:14.482096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5508d1-f97f-4bcd-8f6b-8939f9d83bf4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.482378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5508d1-f97f-4bcd-8f6b-8939f9d83bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.482653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5508d1-f97f-4bcd-8f6b-8939f9d83bf4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.483889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 134/274] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:14.484892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941afaf-030d-4392-b7b5-d052d9710fba None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.487632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941afaf-030d-4392-b7b5-d052d9710fba None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.487632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941afaf-030d-4392-b7b5-d052d9710fba None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.487632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 135/275] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:14.490332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca907-8d86-4db2-8443-d404555fe5f3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.490841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca907-8d86-4db2-8443-d404555fe5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.492417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca907-8d86-4db2-8443-d404555fe5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.511810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e45ca907-8d86-4db2-8443-d404555fe5f3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:14.513008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e45ca907-8d86-4db2-8443-d404555fe5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:14.513186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a135f-1271-4013-aa46-86d3e1f54a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.513806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a135f-1271-4013-aa46-86d3e1f54a5f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.514084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a135f-1271-4013-aa46-86d3e1f54a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.514354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a135f-1271-4013-aa46-86d3e1f54a5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.529042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a135f-1271-4013-aa46-86d3e1f54a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f18a135f-1271-4013-aa46-86d3e1f54a5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:14.535638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:14.536536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:14.537397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 141/276] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:14.538589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953771-d001-447b-9908-917f34d968dc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.538589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953771-d001-447b-9908-917f34d968dc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.538751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953771-d001-447b-9908-917f34d968dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.557574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c2953771-d001-447b-9908-917f34d968dc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:14.558749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c2953771-d001-447b-9908-917f34d968dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:14.592253 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 136/277] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:14.592857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca907-8d86-4db2-8443-d404555fe5f3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.611214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:14.648642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 142/278] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:14.681464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:14.702724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca907-8d86-4db2-8443-d404555fe5f3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.738145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.738973 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.739394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.739803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.740599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:14.741119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:14.742670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:14.751196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 137/279] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:14.759586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2953771-d001-447b-9908-917f34d968dc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.759754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.881147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbbfa0-ab5e-4b1e-a088-c5aca65b4c6a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.883891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2953771-d001-447b-9908-917f34d968dc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:14.909429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:14.917829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02b5ec-ca8e-4c97-93fa-f121d3f86825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.918452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b5ec-ca8e-4c97-93fa-f121d3f86825 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.918730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b5ec-ca8e-4c97-93fa-f121d3f86825 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.918999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b5ec-ca8e-4c97-93fa-f121d3f86825 None admin] PATH_INFO: `/v3/users/0516e575382241ac8596f670646689dd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.919619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554dd82-3f60-4c91-a86c-523337839827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:14.920444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554dd82-3f60-4c91-a86c-523337839827 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:14.920885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554dd82-3f60-4c91-a86c-523337839827 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:14.921325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554dd82-3f60-4c91-a86c-523337839827 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:14.931990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554dd82-3f60-4c91-a86c-523337839827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:14.932534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02b5ec-ca8e-4c97-93fa-f121d3f86825 None admin] RBAC: Authorizing `identity:get_user(user_id=0516e575382241ac8596f670646689dd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:14.934030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02b5ec-ca8e-4c97-93fa-f121d3f86825 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:14.935640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 138/280] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:14 2022] GET /identity/v3/users/0516e575382241ac8596f670646689dd => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:14.936810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02b5ec-ca8e-4c97-93fa-f121d3f86825 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2554dd82-3f60-4c91-a86c-523337839827 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:14.938073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:14.938951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:14.939756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 143/281] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:14.941764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554dd82-3f60-4c91-a86c-523337839827 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:14.980951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.040254 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554dd82-3f60-4c91-a86c-523337839827 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.040416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02b5ec-ca8e-4c97-93fa-f121d3f86825 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.073139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8595a2d-0467-4434-a08d-1bcbbca534ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.073580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c398e61-974e-46f7-b68e-ac948857de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.073766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8595a2d-0467-4434-a08d-1bcbbca534ec None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.074044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8595a2d-0467-4434-a08d-1bcbbca534ec None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.074202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c398e61-974e-46f7-b68e-ac948857de2f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.074308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8595a2d-0467-4434-a08d-1bcbbca534ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.074486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c398e61-974e-46f7-b68e-ac948857de2f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.074760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c398e61-974e-46f7-b68e-ac948857de2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.075432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8595a2d-0467-4434-a08d-1bcbbca534ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.076869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8595a2d-0467-4434-a08d-1bcbbca534ec None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.078434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 144/282] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:15.082462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8595a2d-0467-4434-a08d-1bcbbca534ec None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.085360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c398e61-974e-46f7-b68e-ac948857de2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1c398e61-974e-46f7-b68e-ac948857de2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:15.090207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:15.091255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 139/283] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:15.092062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c398e61-974e-46f7-b68e-ac948857de2f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.138811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.187492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8595a2d-0467-4434-a08d-1bcbbca534ec None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.195364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.196102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c398e61-974e-46f7-b68e-ac948857de2f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.221931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.222534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.222814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.223083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.223797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] RBAC: Adding query filter params (role.id=51dbfe81239845968f102b6b956c7061, user.id=0516e575382241ac8596f670646689dd, scope.system=all) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:15.224108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.225581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.229401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.229996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.230270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.230534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.230637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 145/284] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/role_assignments?user.id=0516e575382241ac8596f670646689dd&scope.system=all&role.id=51dbfe81239845968f102b6b956c7061 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:15.231191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:15.231485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.232854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.233885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.249057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 140/285] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:15.249057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.349416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515d866-b852-4af8-9f72-9fef180b8656 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.370503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9247a4e-0cac-49bd-915a-4fba0c6a0cdb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.381648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.387283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fae22-ab16-4fa0-afbe-4c15d253cf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.387978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fae22-ab16-4fa0-afbe-4c15d253cf05 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.388263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fae22-ab16-4fa0-afbe-4c15d253cf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.388534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fae22-ab16-4fa0-afbe-4c15d253cf05 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.389282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fae22-ab16-4fa0-afbe-4c15d253cf05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.390702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fae22-ab16-4fa0-afbe-4c15d253cf05 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.412314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.412939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.413320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.413519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.414185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:15.414492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.415876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.425342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 146/286] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:15 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:15.425342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fae22-ab16-4fa0-afbe-4c15d253cf05 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.425594 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 141/287] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:15.431959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.479515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.556554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac87e8-dfb4-4184-8187-1e3b5d7d5d47 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.580245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fae22-ab16-4fa0-afbe-4c15d253cf05 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.593750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570d116-a88b-49d0-9dc9-a918d1268785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.594400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570d116-a88b-49d0-9dc9-a918d1268785 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.594674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570d116-a88b-49d0-9dc9-a918d1268785 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.594946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570d116-a88b-49d0-9dc9-a918d1268785 None admin] PATH_INFO: `/v3/users/aa2219957a9646e692ba5107ccba4e27` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.596103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570d116-a88b-49d0-9dc9-a918d1268785 None admin] RBAC: Authorizing `identity:get_user(user_id=aa2219957a9646e692ba5107ccba4e27)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.599616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570d116-a88b-49d0-9dc9-a918d1268785 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.599825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 142/288] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/users/aa2219957a9646e692ba5107ccba4e27 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:15.605685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570d116-a88b-49d0-9dc9-a918d1268785 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.622450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08d390-c6aa-40a0-87a7-7fa7b3869e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.623086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d390-c6aa-40a0-87a7-7fa7b3869e78 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.623368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d390-c6aa-40a0-87a7-7fa7b3869e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.623649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08d390-c6aa-40a0-87a7-7fa7b3869e78 None admin] PATH_INFO: `/v3/users/8f5d50b350e54f24a4bb2f9d2d51340e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.624794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08d390-c6aa-40a0-87a7-7fa7b3869e78 None admin] RBAC: Authorizing `identity:get_user(user_id=8f5d50b350e54f24a4bb2f9d2d51340e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.626567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08d390-c6aa-40a0-87a7-7fa7b3869e78 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.628169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 147/289] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/users/8f5d50b350e54f24a4bb2f9d2d51340e => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:15.634220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08d390-c6aa-40a0-87a7-7fa7b3869e78 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.651706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.737052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570d116-a88b-49d0-9dc9-a918d1268785 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.758300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.760577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08d390-c6aa-40a0-87a7-7fa7b3869e78 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:15.782634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ac2a0-16eb-4dc9-a25a-e4c5e26b3829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.783810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac2a0-16eb-4dc9-a25a-e4c5e26b3829 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.784850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac2a0-16eb-4dc9-a25a-e4c5e26b3829 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.785176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac2a0-16eb-4dc9-a25a-e4c5e26b3829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.811119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c1840-37a6-4406-8fa1-25938f102d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:15.811772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1840-37a6-4406-8fa1-25938f102d51 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:15.812069 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1840-37a6-4406-8fa1-25938f102d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:15.812319 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1840-37a6-4406-8fa1-25938f102d51 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:15.814054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c1840-37a6-4406-8fa1-25938f102d51 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.816059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c1840-37a6-4406-8fa1-25938f102d51 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.819425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 148/290] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:15.826499 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c1840-37a6-4406-8fa1-25938f102d51 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:15.891265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ac2a0-16eb-4dc9-a25a-e4c5e26b3829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:15.893389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ac2a0-16eb-4dc9-a25a-e4c5e26b3829 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:15.947735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:15.960732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c1840-37a6-4406-8fa1-25938f102d51 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:16.007987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37440681-0dcd-46de-b7d2-072852f9e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:16.009157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37440681-0dcd-46de-b7d2-072852f9e0ba None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:16.009968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37440681-0dcd-46de-b7d2-072852f9e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:16.010418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37440681-0dcd-46de-b7d2-072852f9e0ba None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251/users/8f5d50b350e54f24a4bb2f9d2d51340e/roles/26eaaf4903bb4dd1a32f47236b451b7d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:16.012909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37440681-0dcd-46de-b7d2-072852f9e0ba None admin] RBAC: Authorizing `identity:create_grant(project_id=94affdd6cbf542aa881f7f689c9d1251, user_id=8f5d50b350e54f24a4bb2f9d2d51340e, role_id=26eaaf4903bb4dd1a32f47236b451b7d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:16.015313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37440681-0dcd-46de-b7d2-072852f9e0ba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:16.017372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 143/291] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:16.025432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ac2a0-16eb-4dc9-a25a-e4c5e26b3829 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:16.040014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 149/292] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:15 2022] PUT /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251/users/8f5d50b350e54f24a4bb2f9d2d51340e/roles/26eaaf4903bb4dd1a32f47236b451b7d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:46:16.160667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ac2a0-16eb-4dc9-a25a-e4c5e26b3829 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:16.211085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1df167-da00-4ac2-a922-3b9ec143e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:16.211652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1df167-da00-4ac2-a922-3b9ec143e74e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:16.211940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1df167-da00-4ac2-a922-3b9ec143e74e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:16.212217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1df167-da00-4ac2-a922-3b9ec143e74e None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:16.214235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1df167-da00-4ac2-a922-3b9ec143e74e None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:16.215798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1df167-da00-4ac2-a922-3b9ec143e74e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:16.217603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 144/293] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:16 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:16.223585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37440681-0dcd-46de-b7d2-072852f9e0ba None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:16.250202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:16.333533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37440681-0dcd-46de-b7d2-072852f9e0ba None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:16.370152 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a852-4d45-4bde-9f16-32071cdd29fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:16.370764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a852-4d45-4bde-9f16-32071cdd29fe None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:16.371087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a852-4d45-4bde-9f16-32071cdd29fe None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:16.371363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a852-4d45-4bde-9f16-32071cdd29fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:16.372085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a852-4d45-4bde-9f16-32071cdd29fe None admin] RBAC: Adding query filter params (role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=94affdd6cbf542aa881f7f689c9d1251, user.id=aa2219957a9646e692ba5107ccba4e27) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:16.372391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a852-4d45-4bde-9f16-32071cdd29fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:16.373898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a852-4d45-4bde-9f16-32071cdd29fe None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:16.380564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 150/294] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:16 2022] GET /identity/v3/role_assignments?user.id=aa2219957a9646e692ba5107ccba4e27&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=51dbfe81239845968f102b6b956c7061 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:17.493848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2306-c900-44f2-89d9-51adab5fdd6e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:17.494396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2306-c900-44f2-89d9-51adab5fdd6e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:17.494396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed2306-c900-44f2-89d9-51adab5fdd6e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:17.495921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 145/295] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:17.501449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e84d69-a049-4295-8332-d774e276732c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:17.501836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e84d69-a049-4295-8332-d774e276732c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:17.501993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e84d69-a049-4295-8332-d774e276732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:17.520595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c9e84d69-a049-4295-8332-d774e276732c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:17.521776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c9e84d69-a049-4295-8332-d774e276732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:17.594988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 151/296] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:17.862086 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed2306-c900-44f2-89d9-51adab5fdd6e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:17.872435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:17.975167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed2306-c900-44f2-89d9-51adab5fdd6e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.010971 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3dacc-17fa-4b5e-89ce-2225f89be3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.011999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3dacc-17fa-4b5e-89ce-2225f89be3ba None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.012477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3dacc-17fa-4b5e-89ce-2225f89be3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.013001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3dacc-17fa-4b5e-89ce-2225f89be3ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.023706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3dacc-17fa-4b5e-89ce-2225f89be3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f0a3dacc-17fa-4b5e-89ce-2225f89be3ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:18.028869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:18.029785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:18.030608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:18.032849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 146/297] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:18.039386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e84d69-a049-4295-8332-d774e276732c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.055163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd48f1-9a84-4eea-b3c7-07b10be24979 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.055774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd48f1-9a84-4eea-b3c7-07b10be24979 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.056251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd48f1-9a84-4eea-b3c7-07b10be24979 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.058093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 147/298] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:18.058251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.064560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28f51c-6b62-49fc-990b-399270a547e6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.064798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28f51c-6b62-49fc-990b-399270a547e6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.065064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28f51c-6b62-49fc-990b-399270a547e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.083799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cf28f51c-6b62-49fc-990b-399270a547e6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:18.085008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf28f51c-6b62-49fc-990b-399270a547e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:18.161394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.165269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 148/299] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:18.170506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e84d69-a049-4295-8332-d774e276732c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.208547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34014d2d-6f9c-46ff-9a2a-cab2f03abd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.209529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014d2d-6f9c-46ff-9a2a-cab2f03abd74 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.210039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014d2d-6f9c-46ff-9a2a-cab2f03abd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.210513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34014d2d-6f9c-46ff-9a2a-cab2f03abd74 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.211397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34014d2d-6f9c-46ff-9a2a-cab2f03abd74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:18.211900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34014d2d-6f9c-46ff-9a2a-cab2f03abd74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:18.213528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34014d2d-6f9c-46ff-9a2a-cab2f03abd74 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:18.223433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 152/300] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:18.231051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28f51c-6b62-49fc-990b-399270a547e6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.247773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8674-6e44-4f11-8be2-37c1dbd267bd None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.248342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8674-6e44-4f11-8be2-37c1dbd267bd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.248816 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a8674-6e44-4f11-8be2-37c1dbd267bd None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.251411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 153/301] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:18.256287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34133d-da83-4124-a865-82b942248c29 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.256571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34133d-da83-4124-a865-82b942248c29 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.256846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34133d-da83-4124-a865-82b942248c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.278792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5e34133d-da83-4124-a865-82b942248c29 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:18.281106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5e34133d-da83-4124-a865-82b942248c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:18.337845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28f51c-6b62-49fc-990b-399270a547e6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.360998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 154/302] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:18.380338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea0ac1-8d53-4080-8b24-8f576af62f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.381003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea0ac1-8d53-4080-8b24-8f576af62f8f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.381400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea0ac1-8d53-4080-8b24-8f576af62f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.381678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea0ac1-8d53-4080-8b24-8f576af62f8f None admin] PATH_INFO: `/v3/users/0516e575382241ac8596f670646689dd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.382869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea0ac1-8d53-4080-8b24-8f576af62f8f None admin] RBAC: Authorizing `identity:get_user(user_id=0516e575382241ac8596f670646689dd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:18.384358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea0ac1-8d53-4080-8b24-8f576af62f8f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:18.386350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 149/303] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:18 2022] GET /identity/v3/users/0516e575382241ac8596f670646689dd => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:18.394577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34133d-da83-4124-a865-82b942248c29 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.409933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.436743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea0ac1-8d53-4080-8b24-8f576af62f8f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.514006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.536197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34133d-da83-4124-a865-82b942248c29 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.558035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea0ac1-8d53-4080-8b24-8f576af62f8f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.575807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04c96e-d1d7-47a4-b0cf-58df5c6b867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.576457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c96e-d1d7-47a4-b0cf-58df5c6b867a None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.576875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c96e-d1d7-47a4-b0cf-58df5c6b867a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.577081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c96e-d1d7-47a4-b0cf-58df5c6b867a None admin] PATH_INFO: `/v3/system/users/0516e575382241ac8596f670646689dd/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.578412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04c96e-d1d7-47a4-b0cf-58df5c6b867a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0516e575382241ac8596f670646689dd, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:18.579826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04c96e-d1d7-47a4-b0cf-58df5c6b867a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:18.589323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 155/304] 10.222.0.45 () {58 vars in 1334 bytes} [Mon Oct 10 11:46:18 2022] PUT /identity/v3/system/users/0516e575382241ac8596f670646689dd/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:18.590763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea3c18-8b95-4248-90a4-45898369ba6a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.590763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea3c18-8b95-4248-90a4-45898369ba6a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.591032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea3c18-8b95-4248-90a4-45898369ba6a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.592251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 156/305] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:18.598061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25ffc2-79b7-40be-9f1c-877ea2ca5d34 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.598354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25ffc2-79b7-40be-9f1c-877ea2ca5d34 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.598684 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25ffc2-79b7-40be-9f1c-877ea2ca5d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.601643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aebbc8-977c-4026-aa8e-d5239294cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.602808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aebbc8-977c-4026-aa8e-d5239294cd92 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.603273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aebbc8-977c-4026-aa8e-d5239294cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.603727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aebbc8-977c-4026-aa8e-d5239294cd92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.620227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5f25ffc2-79b7-40be-9f1c-877ea2ca5d34 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:18.621107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aebbc8-977c-4026-aa8e-d5239294cd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:18.621894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5f25ffc2-79b7-40be-9f1c-877ea2ca5d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-92aebbc8-977c-4026-aa8e-d5239294cd92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:18.629500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:18.630640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:18.631480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:18.634897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 150/306] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:18.639081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aebbc8-977c-4026-aa8e-d5239294cd92 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.706887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 157/307] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:18.708119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25ffc2-79b7-40be-9f1c-877ea2ca5d34 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.710796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.763324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aebbc8-977c-4026-aa8e-d5239294cd92 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.793604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.802447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1130-ea97-409a-92a6-a69939fafdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.803704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1130-ea97-409a-92a6-a69939fafdbe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.804080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1130-ea97-409a-92a6-a69939fafdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.804547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1130-ea97-409a-92a6-a69939fafdbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.805731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e1130-ea97-409a-92a6-a69939fafdbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:18.807228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e1130-ea97-409a-92a6-a69939fafdbe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:18.809210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 151/308] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:18.815306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1130-ea97-409a-92a6-a69939fafdbe None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.855483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25ffc2-79b7-40be-9f1c-877ea2ca5d34 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.892589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.893239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.893514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.894346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.894998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:18.895294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:18.896660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:18.904920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 158/309] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:18.910190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:18.950878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1130-ea97-409a-92a6-a69939fafdbe None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:18.981378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:18.990886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4af3bf-c5f1-4faf-b60d-b0bf1dfffa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:18.991496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af3bf-c5f1-4faf-b60d-b0bf1dfffa26 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:18.991773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af3bf-c5f1-4faf-b60d-b0bf1dfffa26 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:18.992041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af3bf-c5f1-4faf-b60d-b0bf1dfffa26 None admin] PATH_INFO: `/v3/groups` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:18.992666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4af3bf-c5f1-4faf-b60d-b0bf1dfffa26 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:18.994155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4af3bf-c5f1-4faf-b60d-b0bf1dfffa26 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.012428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 152/310] 10.222.0.45 () {60 vars in 1134 bytes} [Mon Oct 10 11:46:18 2022] POST /identity/v3/groups => generated 229 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:19.013539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4af3bf-c5f1-4faf-b60d-b0bf1dfffa26 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.029081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28990a9-9916-403c-9735-5d8004cebfd1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.075176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549544a-a4e5-43de-b623-10f2a7364415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.076009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549544a-a4e5-43de-b623-10f2a7364415 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.076296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549544a-a4e5-43de-b623-10f2a7364415 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.076570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549544a-a4e5-43de-b623-10f2a7364415 None admin] PATH_INFO: `/v3/users/36195c96d68c4b0998f74ba95bb75cc5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.089953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:19.103114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549544a-a4e5-43de-b623-10f2a7364415 None admin] RBAC: Authorizing `identity:get_user(user_id=36195c96d68c4b0998f74ba95bb75cc5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.105549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549544a-a4e5-43de-b623-10f2a7364415 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.113241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 159/311] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:18 2022] GET /identity/v3/users/36195c96d68c4b0998f74ba95bb75cc5 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:19.116381 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549544a-a4e5-43de-b623-10f2a7364415 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.166410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4af3bf-c5f1-4faf-b60d-b0bf1dfffa26 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.217014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbde5b9-6f35-4581-bb89-e0bbf19aa70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.217258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde5b9-6f35-4581-bb89-e0bbf19aa70c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.217541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde5b9-6f35-4581-bb89-e0bbf19aa70c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.217812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbde5b9-6f35-4581-bb89-e0bbf19aa70c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.232485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbde5b9-6f35-4581-bb89-e0bbf19aa70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bdbde5b9-6f35-4581-bb89-e0bbf19aa70c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:19.238166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:19.239073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:19.239881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 153/312] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:19.245657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbde5b9-6f35-4581-bb89-e0bbf19aa70c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.263081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549544a-a4e5-43de-b623-10f2a7364415 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.290761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:19.309251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.310292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.310785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.311304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.312818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] RBAC: Adding query filter params (role.id=26eaaf4903bb4dd1a32f47236b451b7d, user.id=36195c96d68c4b0998f74ba95bb75cc5, scope.system=all) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:19.313386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.314839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.323927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 160/313] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/role_assignments?user.id=36195c96d68c4b0998f74ba95bb75cc5&scope.system=all&role.id=26eaaf4903bb4dd1a32f47236b451b7d => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:19.377941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbde5b9-6f35-4581-bb89-e0bbf19aa70c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.401706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:19.417877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.418503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.418836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.419113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.419808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:19.420176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.421618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.431531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 154/314] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:19.437332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.558606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df0ade-75fd-49e2-8a24-0f12c907f784 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.594893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9258-6370-4644-a48a-bcd753bdd4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.595530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9258-6370-4644-a48a-bcd753bdd4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.595809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9258-6370-4644-a48a-bcd753bdd4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.596080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9258-6370-4644-a48a-bcd753bdd4e2 None admin] PATH_INFO: `/v3/users/8f5d50b350e54f24a4bb2f9d2d51340e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.597319 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e9258-6370-4644-a48a-bcd753bdd4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=8f5d50b350e54f24a4bb2f9d2d51340e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.598886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e9258-6370-4644-a48a-bcd753bdd4e2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.600824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 161/315] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/users/8f5d50b350e54f24a4bb2f9d2d51340e => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:19.606066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.716170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e10f50-7ec9-46f7-bd12-b6548cfdd72d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:19.749579 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a2ff-fa0c-4d67-9382-a79581b9b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:19.750187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a2ff-fa0c-4d67-9382-a79581b9b50b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:19.750465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a2ff-fa0c-4d67-9382-a79581b9b50b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:19.750735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a2ff-fa0c-4d67-9382-a79581b9b50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:19.794916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:19.820570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a2ff-fa0c-4d67-9382-a79581b9b50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:19.822013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a2ff-fa0c-4d67-9382-a79581b9b50b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:19.923017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 155/316] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:46:19.930048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9258-6370-4644-a48a-bcd753bdd4e2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:19.985843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:20.035509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9258-6370-4644-a48a-bcd753bdd4e2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:20.072848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b2e14-5a6f-4e01-873a-86ac350d9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:20.073519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b2e14-5a6f-4e01-873a-86ac350d9612 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:20.073798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b2e14-5a6f-4e01-873a-86ac350d9612 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:20.074070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b2e14-5a6f-4e01-873a-86ac350d9612 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:20.075187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b2e14-5a6f-4e01-873a-86ac350d9612 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:20.076626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b2e14-5a6f-4e01-873a-86ac350d9612 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:20.078630 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 162/317] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:19 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:20.084642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a2ff-fa0c-4d67-9382-a79581b9b50b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:20.158637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:20.184081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a2ff-fa0c-4d67-9382-a79581b9b50b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:20.218929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52fed6-e0a0-4bf5-874a-e5b2159944bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:20.219572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fed6-e0a0-4bf5-874a-e5b2159944bd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:20.219847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fed6-e0a0-4bf5-874a-e5b2159944bd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:20.220116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fed6-e0a0-4bf5-874a-e5b2159944bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:20.220855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52fed6-e0a0-4bf5-874a-e5b2159944bd None admin] RBAC: Adding query filter params (role.id=26eaaf4903bb4dd1a32f47236b451b7d, scope.project.id=94affdd6cbf542aa881f7f689c9d1251, user.id=8f5d50b350e54f24a4bb2f9d2d51340e) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:20.221198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52fed6-e0a0-4bf5-874a-e5b2159944bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:20.222702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52fed6-e0a0-4bf5-874a-e5b2159944bd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:20.229611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 156/318] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:20 2022] GET /identity/v3/role_assignments?user.id=8f5d50b350e54f24a4bb2f9d2d51340e&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=26eaaf4903bb4dd1a32f47236b451b7d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:20.862549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456c44-f6d3-4caf-9d75-f0683bb90d42 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:20.863721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456c44-f6d3-4caf-9d75-f0683bb90d42 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:20.863894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10456c44-f6d3-4caf-9d75-f0683bb90d42 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:20.865330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 163/319] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:20.870434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa2fa-9f96-49fb-828f-4c0d1ca56a88 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:20.870811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa2fa-9f96-49fb-828f-4c0d1ca56a88 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:20.870971 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa2fa-9f96-49fb-828f-4c0d1ca56a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:20.889180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-189aa2fa-9f96-49fb-828f-4c0d1ca56a88 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:20.890354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-189aa2fa-9f96-49fb-828f-4c0d1ca56a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:20.958097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 157/320] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:21.220192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10456c44-f6d3-4caf-9d75-f0683bb90d42 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:21.324833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10456c44-f6d3-4caf-9d75-f0683bb90d42 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:21.338911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689a4f-8482-4fcc-8f73-6229ad5541b1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.339423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689a4f-8482-4fcc-8f73-6229ad5541b1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.339870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98689a4f-8482-4fcc-8f73-6229ad5541b1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.341365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 158/321] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:21.346587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8df42-6609-4b88-aaba-fc3e2884d2ef None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.347679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8df42-6609-4b88-aaba-fc3e2884d2ef None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.348141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8df42-6609-4b88-aaba-fc3e2884d2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.351946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:21.364564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def41b-3f73-48f1-8e57-073781f25edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:21.365242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def41b-3f73-48f1-8e57-073781f25edb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.365580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def41b-3f73-48f1-8e57-073781f25edb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.365854 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def41b-3f73-48f1-8e57-073781f25edb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.367226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7fb8df42-6609-4b88-aaba-fc3e2884d2ef None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:21.368390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7fb8df42-6609-4b88-aaba-fc3e2884d2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:21.377219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5def41b-3f73-48f1-8e57-073781f25edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e5def41b-3f73-48f1-8e57-073781f25edb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:21.382255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:21.383326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:21.384351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 164/322] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:21.389435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def41b-3f73-48f1-8e57-073781f25edb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:21.441418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:21.447342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 159/323] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:21.490938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def41b-3f73-48f1-8e57-073781f25edb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:21.498259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fb3e4-cb77-4832-a9c4-c646caf0c079 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.498549 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fb3e4-cb77-4832-a9c4-c646caf0c079 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.498823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fb3e4-cb77-4832-a9c4-c646caf0c079 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.500154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 160/324] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:21.505303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7073-862c-4019-8bc6-fcadcfb980f7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.505587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7073-862c-4019-8bc6-fcadcfb980f7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.505865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7073-862c-4019-8bc6-fcadcfb980f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.524531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-599f7073-862c-4019-8bc6-fcadcfb980f7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:21.525737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-599f7073-862c-4019-8bc6-fcadcfb980f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:21.535975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:21.536909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.537052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.537291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.537916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:21.538213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:21.539697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:21.548723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 165/325] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:21.554180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:21.593078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 161/326] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:21.603355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:21.658916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518d0c9-c87a-48a1-8815-83276e856ef9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:21.692172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967b1da-d646-480d-80a9-b47b7a53ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:21.692803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b1da-d646-480d-80a9-b47b7a53ba67 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.693127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b1da-d646-480d-80a9-b47b7a53ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.693404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967b1da-d646-480d-80a9-b47b7a53ba67 None admin] PATH_INFO: `/v3/users/0516e575382241ac8596f670646689dd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.694524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967b1da-d646-480d-80a9-b47b7a53ba67 None admin] RBAC: Authorizing `identity:get_user(user_id=0516e575382241ac8596f670646689dd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:21.695972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967b1da-d646-480d-80a9-b47b7a53ba67 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:21.697732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 166/327] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:21 2022] GET /identity/v3/users/0516e575382241ac8596f670646689dd => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:21.704293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7073-862c-4019-8bc6-fcadcfb980f7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:21.710005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967b1da-d646-480d-80a9-b47b7a53ba67 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:21.818830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7073-862c-4019-8bc6-fcadcfb980f7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:21.819586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967b1da-d646-480d-80a9-b47b7a53ba67 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:21.835567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:21.849920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:21.857579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab20a-6614-4048-a1a2-b27048969a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:21.858210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab20a-6614-4048-a1a2-b27048969a62 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.858488 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab20a-6614-4048-a1a2-b27048969a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.858759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab20a-6614-4048-a1a2-b27048969a62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.859031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:21.859642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:21.859877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab20a-6614-4048-a1a2-b27048969a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:21.859990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:21.860179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:21.860903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] RBAC: Adding query filter params (role.id=51dbfe81239845968f102b6b956c7061, user.id=0516e575382241ac8596f670646689dd, scope.system=all) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:21.861360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab20a-6614-4048-a1a2-b27048969a62 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:21.862753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:21.863230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 167/328] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:21.863995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab20a-6614-4048-a1a2-b27048969a62 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:21.864319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:21.877912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 162/329] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Oct 10 11:46:21 2022] GET /identity/v3/role_assignments?user.id=0516e575382241ac8596f670646689dd&scope.system=all&role.id=51dbfe81239845968f102b6b956c7061 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:21.879392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:21.977207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab20a-6614-4048-a1a2-b27048969a62 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:22.000515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864fe3e-91d0-46d1-9f3f-656700549392 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:22.013567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbf71-d671-4c0b-845b-a0bb501f8881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:22.014207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbf71-d671-4c0b-845b-a0bb501f8881 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:22.014485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbf71-d671-4c0b-845b-a0bb501f8881 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:22.014758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbf71-d671-4c0b-845b-a0bb501f8881 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:22.026134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbbf71-d671-4c0b-845b-a0bb501f8881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c5bbbf71-d671-4c0b-845b-a0bb501f8881 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:22.031685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:22.032659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:22.033517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 168/330] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:22.038847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbf71-d671-4c0b-845b-a0bb501f8881 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:22.041144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd627c6-78c2-47f3-9b4d-191f66066d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:22.041770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd627c6-78c2-47f3-9b4d-191f66066d57 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:22.042337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd627c6-78c2-47f3-9b4d-191f66066d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:22.042623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd627c6-78c2-47f3-9b4d-191f66066d57 None admin] PATH_INFO: `/v3/groups` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:22.043260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd627c6-78c2-47f3-9b4d-191f66066d57 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:22.044742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd627c6-78c2-47f3-9b4d-191f66066d57 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:22.064077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 163/331] 10.222.0.45 () {60 vars in 1134 bytes} [Mon Oct 10 11:46:21 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:22.092752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:22.161920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbf71-d671-4c0b-845b-a0bb501f8881 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:22.197436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:22.198084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:22.198367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:22.198643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:22.199314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:22.199643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:22.201093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:22.210323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 169/332] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:22.216046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd627c6-78c2-47f3-9b4d-191f66066d57 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:22.264192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:22.320196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd627c6-78c2-47f3-9b4d-191f66066d57 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:22.354346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504805e-422d-4c6f-a9da-16e4e37946d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:22.354983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504805e-422d-4c6f-a9da-16e4e37946d0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:22.355264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504805e-422d-4c6f-a9da-16e4e37946d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:22.355535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504805e-422d-4c6f-a9da-16e4e37946d0 None admin] PATH_INFO: `/v3/users/36195c96d68c4b0998f74ba95bb75cc5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:22.356696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504805e-422d-4c6f-a9da-16e4e37946d0 None admin] RBAC: Authorizing `identity:get_user(user_id=36195c96d68c4b0998f74ba95bb75cc5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:22.358180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504805e-422d-4c6f-a9da-16e4e37946d0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:22.360058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 164/333] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:22 2022] GET /identity/v3/users/36195c96d68c4b0998f74ba95bb75cc5 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:22.366257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:22.468414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5f21c-bee0-4968-897c-4f3eb52b620f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:22.470204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:22.507796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad157b0d-36fb-4eac-b1df-371e2870d196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:22.508749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad157b0d-36fb-4eac-b1df-371e2870d196 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:22.509232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad157b0d-36fb-4eac-b1df-371e2870d196 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:22.509672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad157b0d-36fb-4eac-b1df-371e2870d196 None admin] PATH_INFO: `/v3/system/users/36195c96d68c4b0998f74ba95bb75cc5/roles/26eaaf4903bb4dd1a32f47236b451b7d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:22.511282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad157b0d-36fb-4eac-b1df-371e2870d196 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36195c96d68c4b0998f74ba95bb75cc5, role_id=26eaaf4903bb4dd1a32f47236b451b7d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:22.512675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad157b0d-36fb-4eac-b1df-371e2870d196 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:22.521525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 170/334] 10.222.0.45 () {58 vars in 1334 bytes} [Mon Oct 10 11:46:22 2022] PUT /identity/v3/system/users/36195c96d68c4b0998f74ba95bb75cc5/roles/26eaaf4903bb4dd1a32f47236b451b7d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:24.429393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925964-03d9-4858-b42e-4327e07ca4c2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:24.430338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925964-03d9-4858-b42e-4327e07ca4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:24.430623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14925964-03d9-4858-b42e-4327e07ca4c2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:24.432106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 165/335] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:24.437818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce5022-8234-477d-89f8-ac66268362c9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:24.438622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce5022-8234-477d-89f8-ac66268362c9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:24.439108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce5022-8234-477d-89f8-ac66268362c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:24.461015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b3ce5022-8234-477d-89f8-ac66268362c9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:24.462492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b3ce5022-8234-477d-89f8-ac66268362c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:24.539430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 171/336] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:24.669532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7daf1a-ff5c-41b2-8ecb-ca3d61caa281 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:24.670150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7daf1a-ff5c-41b2-8ecb-ca3d61caa281 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:24.670651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7daf1a-ff5c-41b2-8ecb-ca3d61caa281 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:24.672484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 166/337] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:24.677684 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68cfd8-7fbb-41dc-a660-ff79498279f9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:24.678216 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68cfd8-7fbb-41dc-a660-ff79498279f9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:24.678679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68cfd8-7fbb-41dc-a660-ff79498279f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:24.703693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6b68cfd8-7fbb-41dc-a660-ff79498279f9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:24.705171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6b68cfd8-7fbb-41dc-a660-ff79498279f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:24.784617 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 172/338] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:25.127031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7daf1a-ff5c-41b2-8ecb-ca3d61caa281 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:25.250815 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7daf1a-ff5c-41b2-8ecb-ca3d61caa281 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:25.270803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:25.291515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4123df-dc81-45b4-b16e-74fe0674cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:25.292149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4123df-dc81-45b4-b16e-74fe0674cf0c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:25.292427 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4123df-dc81-45b4-b16e-74fe0674cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:25.292696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4123df-dc81-45b4-b16e-74fe0674cf0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:25.308551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4123df-dc81-45b4-b16e-74fe0674cf0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4e4123df-dc81-45b4-b16e-74fe0674cf0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:25.313503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:25.314390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:25.315192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:25.317877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 167/339] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:25.323014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68cfd8-7fbb-41dc-a660-ff79498279f9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:25.351710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:25.387999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4123df-dc81-45b4-b16e-74fe0674cf0c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:25.507003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68cfd8-7fbb-41dc-a660-ff79498279f9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:25.576986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d355b-efbb-4970-83e6-0345fcc59c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:25.579038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d355b-efbb-4970-83e6-0345fcc59c09 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:25.579311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d355b-efbb-4970-83e6-0345fcc59c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:25.579581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d355b-efbb-4970-83e6-0345fcc59c09 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:25.580243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d355b-efbb-4970-83e6-0345fcc59c09 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:25.580543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d355b-efbb-4970-83e6-0345fcc59c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:25.582525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d355b-efbb-4970-83e6-0345fcc59c09 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:25.597346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4123df-dc81-45b4-b16e-74fe0674cf0c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:25.603878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 173/340] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:25.605303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b97aa0-7077-403d-940b-3da73c17623a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:25.605593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b97aa0-7077-403d-940b-3da73c17623a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:25.605871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b97aa0-7077-403d-940b-3da73c17623a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:25.607060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 174/341] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:25.609021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6dea7-ebce-4f75-ba2e-ef8e2f0b31eb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:25.609838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6dea7-ebce-4f75-ba2e-ef8e2f0b31eb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:25.610304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6dea7-ebce-4f75-ba2e-ef8e2f0b31eb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:25.612049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 175/342] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:25.613061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6dea7-ebce-4f75-ba2e-ef8e2f0b31eb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:25.650787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f7070-f633-4c00-8c38-1203e2c38141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:25.651902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f7070-f633-4c00-8c38-1203e2c38141 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:25.652322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f7070-f633-4c00-8c38-1203e2c38141 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:25.652829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f7070-f633-4c00-8c38-1203e2c38141 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:25.666595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f7070-f633-4c00-8c38-1203e2c38141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b91f7070-f633-4c00-8c38-1203e2c38141 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:25.671891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:25.672789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:25.673981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:25.677703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 168/343] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:25.680276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63c77a-024d-43fe-9e29-b50a0ad56d88 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:25.681146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63c77a-024d-43fe-9e29-b50a0ad56d88 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:25.681560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63c77a-024d-43fe-9e29-b50a0ad56d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:25.706408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5c63c77a-024d-43fe-9e29-b50a0ad56d88 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:25.707976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5c63c77a-024d-43fe-9e29-b50a0ad56d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:25.739076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:25.744322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:25.756423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6dea7-ebce-4f75-ba2e-ef8e2f0b31eb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:25.799802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 169/344] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:25.803625 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd794aa-7007-42e3-872b-574f9a6e8ee7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:25.807889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd794aa-7007-42e3-872b-574f9a6e8ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:25.808149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd794aa-7007-42e3-872b-574f9a6e8ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:25.811289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2813bc-b428-4f52-b883-f43108cca21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:25.812227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2813bc-b428-4f52-b883-f43108cca21e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:25.812702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2813bc-b428-4f52-b883-f43108cca21e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:25.813204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2813bc-b428-4f52-b883-f43108cca21e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:25.843970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9fd794aa-7007-42e3-872b-574f9a6e8ee7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:25.847069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9fd794aa-7007-42e3-872b-574f9a6e8ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:25.959462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2813bc-b428-4f52-b883-f43108cca21e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:25.961229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2813bc-b428-4f52-b883-f43108cca21e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:25.989790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 170/345] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:25.990944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd794aa-7007-42e3-872b-574f9a6e8ee7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:26.141183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:26.170297 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 176/346] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:26.176531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2813bc-b428-4f52-b883-f43108cca21e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:26.204197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:26.215766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd794aa-7007-42e3-872b-574f9a6e8ee7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:26.273629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:26.274246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.274527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.274799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.275464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:26.275775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:26.277240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:26.289016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 171/347] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:26.289816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:26.325855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2813bc-b428-4f52-b883-f43108cca21e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:26.363874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca953cf-2e7e-4ff4-83b7-e3321a0b014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:26.364544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca953cf-2e7e-4ff4-83b7-e3321a0b014e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.364822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca953cf-2e7e-4ff4-83b7-e3321a0b014e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.365166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca953cf-2e7e-4ff4-83b7-e3321a0b014e None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.366304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca953cf-2e7e-4ff4-83b7-e3321a0b014e None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:26.368007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca953cf-2e7e-4ff4-83b7-e3321a0b014e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:26.370025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 177/348] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:26 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:26.371167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e9b4-e771-4898-8c88-ddd12a162e85 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.371446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e9b4-e771-4898-8c88-ddd12a162e85 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.371716 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e9b4-e771-4898-8c88-ddd12a162e85 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.373046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 178/349] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:26.373737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e9b4-e771-4898-8c88-ddd12a162e85 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:26.399433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b4f13-0ad3-4f05-b45d-cbb7f3252fcc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:26.437320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37e950-0ab9-484a-b4d8-48e65427c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:26.438235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37e950-0ab9-484a-b4d8-48e65427c591 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.438514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37e950-0ab9-484a-b4d8-48e65427c591 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.438895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37e950-0ab9-484a-b4d8-48e65427c591 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.439939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:26.453722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37e950-0ab9-484a-b4d8-48e65427c591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ab37e950-0ab9-484a-b4d8-48e65427c591 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:26.459257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:26.460210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:26.461159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 172/350] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:26.461841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37e950-0ab9-484a-b4d8-48e65427c591 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:26.486008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:26.500851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e9b4-e771-4898-8c88-ddd12a162e85 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:26.544645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753df2e-1305-42b7-8bf5-b561443f6bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:26.545435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753df2e-1305-42b7-8bf5-b561443f6bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.545817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753df2e-1305-42b7-8bf5-b561443f6bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.546219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753df2e-1305-42b7-8bf5-b561443f6bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.598473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37e950-0ab9-484a-b4d8-48e65427c591 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:26.623368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753df2e-1305-42b7-8bf5-b561443f6bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:26.624772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753df2e-1305-42b7-8bf5-b561443f6bd6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:26.645033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beec8-77d4-4237-bdc0-569bc086be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:26.645033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beec8-77d4-4237-bdc0-569bc086be3e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.645033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beec8-77d4-4237-bdc0-569bc086be3e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.645033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beec8-77d4-4237-bdc0-569bc086be3e None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.651328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beec8-77d4-4237-bdc0-569bc086be3e None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:26.652122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beec8-77d4-4237-bdc0-569bc086be3e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:26.655823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 173/351] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:26 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:26.655823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2e71-500f-4722-9eee-a8aa626c2521 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.655823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2e71-500f-4722-9eee-a8aa626c2521 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.655823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2e71-500f-4722-9eee-a8aa626c2521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.686938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f69d2e71-500f-4722-9eee-a8aa626c2521 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:26.688125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f69d2e71-500f-4722-9eee-a8aa626c2521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:26.699582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:26.756192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 179/352] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:26.757367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753df2e-1305-42b7-8bf5-b561443f6bd6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:26.782851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 174/353] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:26.783851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2e71-500f-4722-9eee-a8aa626c2521 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:26.797769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:26.904055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753df2e-1305-42b7-8bf5-b561443f6bd6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:26.909666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2e71-500f-4722-9eee-a8aa626c2521 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:26.950208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8fb08-39c7-4263-bd9d-1371187fc3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:26.951075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fb08-39c7-4263-bd9d-1371187fc3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.951519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fb08-39c7-4263-bd9d-1371187fc3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.951925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8fb08-39c7-4263-bd9d-1371187fc3b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.952166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:26.953099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:26.953502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:26.953877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:26.954699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:26.955144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:26.957630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:26.965415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8fb08-39c7-4263-bd9d-1371187fc3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:26.967138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 175/354] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:26.967854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ead8fb08-39c7-4263-bd9d-1371187fc3b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:26.973230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:26.974118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 10 11:46:26.974910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:26.981434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 180/355] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:26.983628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8fb08-39c7-4263-bd9d-1371187fc3b9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.032202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.061434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.104430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76280eb6-fc6c-4c60-87cf-af69eb731b8e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.145113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.145621 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8fb08-39c7-4263-bd9d-1371187fc3b9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.145754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.145990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.146262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.146995 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] RBAC: Adding query filter params (group.id=b081525e708a4c69808df1d0f3296889, role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=0229e1f6c84e43d0ab052db94ab62329) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:27.147301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:27.148731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:27.154246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 176/356] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:26 2022] GET /identity/v3/role_assignments?group.id=b081525e708a4c69808df1d0f3296889&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=51dbfe81239845968f102b6b956c7061 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:27.155051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.196923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bc9a-1d69-418c-abc4-b75ae543726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.198018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bc9a-1d69-418c-abc4-b75ae543726f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.198511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bc9a-1d69-418c-abc4-b75ae543726f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.198997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4bc9a-1d69-418c-abc4-b75ae543726f None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.200504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4bc9a-1d69-418c-abc4-b75ae543726f None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:27.202274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4bc9a-1d69-418c-abc4-b75ae543726f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:27.204518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 181/357] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:26 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:27.205650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bc9a-1d69-418c-abc4-b75ae543726f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.297192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9c9e7-5810-4e9d-b000-3cd05d15a7a7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.316174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.334560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4bc9a-1d69-418c-abc4-b75ae543726f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.341823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1ec74-ff5a-4cf8-a064-d10b469d3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.342449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1ec74-ff5a-4cf8-a064-d10b469d3655 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.342751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1ec74-ff5a-4cf8-a064-d10b469d3655 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.343637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1ec74-ff5a-4cf8-a064-d10b469d3655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.350880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.381943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a79c1-7e5d-47bf-80bf-258afafbcfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.382565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a79c1-7e5d-47bf-80bf-258afafbcfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.383085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a79c1-7e5d-47bf-80bf-258afafbcfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.383085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a79c1-7e5d-47bf-80bf-258afafbcfe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.383755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a79c1-7e5d-47bf-80bf-258afafbcfe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:27.384062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a79c1-7e5d-47bf-80bf-258afafbcfe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:27.385487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a79c1-7e5d-47bf-80bf-258afafbcfe8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:27.396517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 182/358] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:27.398561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1d47-4eb7-429f-8178-589491a5e380 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.399067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1d47-4eb7-429f-8178-589491a5e380 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.399547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1d47-4eb7-429f-8178-589491a5e380 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.401292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 183/359] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:27.402213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1d47-4eb7-429f-8178-589491a5e380 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.435312 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1ec74-ff5a-4cf8-a064-d10b469d3655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:27.436774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1ec74-ff5a-4cf8-a064-d10b469d3655 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:27.534802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1d47-4eb7-429f-8178-589491a5e380 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.574781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 177/360] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:27.575932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1ec74-ff5a-4cf8-a064-d10b469d3655 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.580276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cdf15-ff94-472a-a65a-2af492f3cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.584151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cdf15-ff94-472a-a65a-2af492f3cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.584151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cdf15-ff94-472a-a65a-2af492f3cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.584151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cdf15-ff94-472a-a65a-2af492f3cd8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.598815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cdf15-ff94-472a-a65a-2af492f3cd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bf6cdf15-ff94-472a-a65a-2af492f3cd8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:27.607887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:27.608863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 184/361] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:27.610067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cdf15-ff94-472a-a65a-2af492f3cd8c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.622007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.624444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.710315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1ec74-ff5a-4cf8-a064-d10b469d3655 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.740935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cdf15-ff94-472a-a65a-2af492f3cd8c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.755300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32241b8-a513-4b50-baa4-099dcee13dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.756071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32241b8-a513-4b50-baa4-099dcee13dce None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.756412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32241b8-a513-4b50-baa4-099dcee13dce None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.756798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32241b8-a513-4b50-baa4-099dcee13dce None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.758070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32241b8-a513-4b50-baa4-099dcee13dce None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:27.759703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32241b8-a513-4b50-baa4-099dcee13dce None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:27.761526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 178/362] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:27.762708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fa5d-7e79-4161-979d-748d4391ce35 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.762994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fa5d-7e79-4161-979d-748d4391ce35 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.763262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75fa5d-7e79-4161-979d-748d4391ce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.783031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4d75fa5d-7e79-4161-979d-748d4391ce35 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:27.784252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4d75fa5d-7e79-4161-979d-748d4391ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:27.785930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfac51-756d-42bf-9126-37ed91dc2bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.786783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfac51-756d-42bf-9126-37ed91dc2bdb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.787241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfac51-756d-42bf-9126-37ed91dc2bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.787722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfac51-756d-42bf-9126-37ed91dc2bdb None admin] PATH_INFO: `/v3/users/36195c96d68c4b0998f74ba95bb75cc5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.789694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfac51-756d-42bf-9126-37ed91dc2bdb None admin] RBAC: Authorizing `identity:get_user(user_id=36195c96d68c4b0998f74ba95bb75cc5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:27.791172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfac51-756d-42bf-9126-37ed91dc2bdb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:27.792899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 185/363] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/users/36195c96d68c4b0998f74ba95bb75cc5 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:27.797030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfac51-756d-42bf-9126-37ed91dc2bdb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.880772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 179/364] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:27.881723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75fa5d-7e79-4161-979d-748d4391ce35 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:27.905662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.921993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:27.935174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfac51-756d-42bf-9126-37ed91dc2bdb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:27.982096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cc90b-8873-402c-bfae-37b758c4a583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:27.982735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cc90b-8873-402c-bfae-37b758c4a583 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:27.983020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cc90b-8873-402c-bfae-37b758c4a583 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:27.983524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cc90b-8873-402c-bfae-37b758c4a583 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:27.985185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cc90b-8873-402c-bfae-37b758c4a583 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:27.986890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cc90b-8873-402c-bfae-37b758c4a583 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:27.990112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 186/365] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:27.990927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cc90b-8873-402c-bfae-37b758c4a583 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.013388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75fa5d-7e79-4161-979d-748d4391ce35 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.058634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.059502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.059621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.059868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.060529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:28.060826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.062224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.073164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 180/366] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.073444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.124073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cc90b-8873-402c-bfae-37b758c4a583 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.162472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.163467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.163955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.164436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.165411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] RBAC: Adding query filter params (group.id=b081525e708a4c69808df1d0f3296889, role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=0229e1f6c84e43d0ab052db94ab62329) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:28.165928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.167625 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.174964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 187/367] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:27 2022] GET /identity/v3/role_assignments?group.id=b081525e708a4c69808df1d0f3296889&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.181750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.187851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.195378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d770cd-9cba-4d57-b146-fa3061636917 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.201781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.242262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.242880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.243221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.243493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.244268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] RBAC: Adding query filter params (role.id=26eaaf4903bb4dd1a32f47236b451b7d, user.id=36195c96d68c4b0998f74ba95bb75cc5, scope.system=all) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:28.244576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.246119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.260784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 181/368] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/role_assignments?user.id=36195c96d68c4b0998f74ba95bb75cc5&scope.system=all&role.id=26eaaf4903bb4dd1a32f47236b451b7d => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.265341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.384174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5496c3-d73c-4e01-be28-ba20f89b9c32 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.452474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430908e2-781c-4798-a17a-37ae90a338c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.453298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430908e2-781c-4798-a17a-37ae90a338c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.453948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430908e2-781c-4798-a17a-37ae90a338c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.454231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430908e2-781c-4798-a17a-37ae90a338c4 None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.455689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430908e2-781c-4798-a17a-37ae90a338c4 None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.456585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e2cb3-3042-415b-bcdd-8339282ec9d1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.457753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430908e2-781c-4798-a17a-37ae90a338c4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.459782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 188/369] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.463035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430908e2-781c-4798-a17a-37ae90a338c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.522329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89194da5-7899-4d5c-8f57-8b32df986ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.522953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89194da5-7899-4d5c-8f57-8b32df986ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.523416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89194da5-7899-4d5c-8f57-8b32df986ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.523717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89194da5-7899-4d5c-8f57-8b32df986ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.565541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.575406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.606022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430908e2-781c-4798-a17a-37ae90a338c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.625516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89194da5-7899-4d5c-8f57-8b32df986ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.627976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89194da5-7899-4d5c-8f57-8b32df986ff6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.641797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4250-41bf-4a63-8f91-f8802106fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.642438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4250-41bf-4a63-8f91-f8802106fd89 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.642789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4250-41bf-4a63-8f91-f8802106fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.642975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4250-41bf-4a63-8f91-f8802106fd89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.655344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e4250-41bf-4a63-8f91-f8802106fd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b93e4250-41bf-4a63-8f91-f8802106fd89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:28.661043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:28.661962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:28.662778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:28.663409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 189/370] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:28.663956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4250-41bf-4a63-8f91-f8802106fd89 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.748907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 182/371] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:28.750032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89194da5-7899-4d5c-8f57-8b32df986ff6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.776823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4250-41bf-4a63-8f91-f8802106fd89 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.815906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.817103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.817382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.817650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.818442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] RBAC: Adding query filter params (group.id=b081525e708a4c69808df1d0f3296889, role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=94affdd6cbf542aa881f7f689c9d1251) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:28.818752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.820187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.822076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.824500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:28.826695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 190/372] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/role_assignments?group.id=b081525e708a4c69808df1d0f3296889&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=51dbfe81239845968f102b6b956c7061 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.827638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.914872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89194da5-7899-4d5c-8f57-8b32df986ff6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.939888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b664f-5925-4fe2-a343-97a9094eddd1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:28.978530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.978760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9420037-e4cf-4f8f-9013-359bd870053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:28.979163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.979285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9420037-e4cf-4f8f-9013-359bd870053a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:28.979440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9420037-e4cf-4f8f-9013-359bd870053a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.979528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:28.979699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9420037-e4cf-4f8f-9013-359bd870053a None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.979801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:28.980379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:28.980690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.980865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9420037-e4cf-4f8f-9013-359bd870053a None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:28.982089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.982322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9420037-e4cf-4f8f-9013-359bd870053a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:28.984240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 191/373] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:28.992560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9420037-e4cf-4f8f-9013-359bd870053a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:28.994703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 183/374] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:29.003359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.071252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.116457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9420037-e4cf-4f8f-9013-359bd870053a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.159819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328894-3769-46f8-b615-81647adbaffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.160513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328894-3769-46f8-b615-81647adbaffc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.160789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328894-3769-46f8-b615-81647adbaffc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.161090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3328894-3769-46f8-b615-81647adbaffc None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.162352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3328894-3769-46f8-b615-81647adbaffc None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.164020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3328894-3769-46f8-b615-81647adbaffc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.165924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 192/375] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:28 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:29.172062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328894-3769-46f8-b615-81647adbaffc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.228539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5333f-cd25-4d01-8a88-3e656257c17b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.249655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.282633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6cd3a-57f2-46eb-af36-6e81c959888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.283422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6cd3a-57f2-46eb-af36-6e81c959888b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.283813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6cd3a-57f2-46eb-af36-6e81c959888b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.284093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6cd3a-57f2-46eb-af36-6e81c959888b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.303318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3328894-3769-46f8-b615-81647adbaffc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.351819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.352440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.352717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.353002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.353742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] RBAC: Adding query filter params (group.id=b081525e708a4c69808df1d0f3296889, role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=94affdd6cbf542aa881f7f689c9d1251) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:29.354047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.355484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.357330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.362033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 193/376] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/role_assignments?group.id=b081525e708a4c69808df1d0f3296889&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:29.388614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6cd3a-57f2-46eb-af36-6e81c959888b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.390152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6cd3a-57f2-46eb-af36-6e81c959888b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.500600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 184/377] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:29.507702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.653061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bfd79-2817-4642-9a49-d20b63a4c846 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.690796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e8b7f-53f9-49a5-8a8d-b7986a365162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.691478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8b7f-53f9-49a5-8a8d-b7986a365162 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.691754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8b7f-53f9-49a5-8a8d-b7986a365162 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.692083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e8b7f-53f9-49a5-8a8d-b7986a365162 None admin] PATH_INFO: `/v3/projects/46b9ca29061a40d98972b8db835132e5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.693305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8b7f-53f9-49a5-8a8d-b7986a365162 None admin] RBAC: Authorizing `identity:get_project(project_id=46b9ca29061a40d98972b8db835132e5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.694808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e8b7f-53f9-49a5-8a8d-b7986a365162 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.696719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 194/378] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/projects/46b9ca29061a40d98972b8db835132e5 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:29.702363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6cd3a-57f2-46eb-af36-6e81c959888b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.720953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.771368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349168e-daa1-4e0f-8a57-d860a60acef8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.771690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349168e-daa1-4e0f-8a57-d860a60acef8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.771909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349168e-daa1-4e0f-8a57-d860a60acef8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.774475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 195/379] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:29.782596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61625-81f8-4ce6-a294-9b9dc393e5ab None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.782877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61625-81f8-4ce6-a294-9b9dc393e5ab None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.783160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf61625-81f8-4ce6-a294-9b9dc393e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.815814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6cd3a-57f2-46eb-af36-6e81c959888b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:29.834019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9bf61625-81f8-4ce6-a294-9b9dc393e5ab None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:29.835225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9bf61625-81f8-4ce6-a294-9b9dc393e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:29.858291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319820-dc9f-4bc9-a69a-ece75467501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:29.859269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319820-dc9f-4bc9-a69a-ece75467501c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:29.859765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319820-dc9f-4bc9-a69a-ece75467501c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:29.860231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319820-dc9f-4bc9-a69a-ece75467501c None admin] PATH_INFO: `/v3/groups/2b9c9c343e04400cbe0c9985ee948f09` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:29.868439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68319820-dc9f-4bc9-a69a-ece75467501c None admin] RBAC: Authorizing `identity:get_group(group_id=2b9c9c343e04400cbe0c9985ee948f09)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:29.870186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68319820-dc9f-4bc9-a69a-ece75467501c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:29.874757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 185/380] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/groups/2b9c9c343e04400cbe0c9985ee948f09 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:29.882144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319820-dc9f-4bc9-a69a-ece75467501c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:29.937234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:29.951599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 196/381] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 10 11:46:29.984842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:30.010379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319820-dc9f-4bc9-a69a-ece75467501c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.047132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.048106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.048579 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.049097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.050005 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] RBAC: Adding query filter params (group.id=2b9c9c343e04400cbe0c9985ee948f09, role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=46b9ca29061a40d98972b8db835132e5) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:30.050520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.052151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:30.058177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 186/382] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:29 2022] GET /identity/v3/role_assignments?group.id=2b9c9c343e04400cbe0c9985ee948f09&scope.project.id=46b9ca29061a40d98972b8db835132e5&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:30.482330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf61625-81f8-4ce6-a294-9b9dc393e5ab None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:30.601053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf61625-81f8-4ce6-a294-9b9dc393e5ab None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.641970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbb7f8-c6b7-49da-bf22-e30766f41253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.642991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb7f8-c6b7-49da-bf22-e30766f41253 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.643463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb7f8-c6b7-49da-bf22-e30766f41253 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.643928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb7f8-c6b7-49da-bf22-e30766f41253 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.658681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbb7f8-c6b7-49da-bf22-e30766f41253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-74fbb7f8-c6b7-49da-bf22-e30766f41253 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:30.664507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:30.665440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:30.666245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:30.672996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 197/383] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:30.674273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:30.820994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebfdcc-fe2e-438f-8fda-3ad4573a8bbe None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:30.868506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9946304-4af4-4846-b2fd-c6c080a76d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:30.869147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946304-4af4-4846-b2fd-c6c080a76d8f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:30.869420 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946304-4af4-4846-b2fd-c6c080a76d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:30.869688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946304-4af4-4846-b2fd-c6c080a76d8f None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:30.870350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9946304-4af4-4846-b2fd-c6c080a76d8f None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:30.870646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9946304-4af4-4846-b2fd-c6c080a76d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:30.872001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9946304-4af4-4846-b2fd-c6c080a76d8f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:30.881837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 187/384] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:30.890248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbb7f8-c6b7-49da-bf22-e30766f41253 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:30.970114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:31.021679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbb7f8-c6b7-49da-bf22-e30766f41253 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:31.068832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c790b7-96ce-448e-a0ae-9aac8bec595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:31.069402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c790b7-96ce-448e-a0ae-9aac8bec595e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.069677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c790b7-96ce-448e-a0ae-9aac8bec595e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.069946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c790b7-96ce-448e-a0ae-9aac8bec595e None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.073649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c790b7-96ce-448e-a0ae-9aac8bec595e None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:31.075115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c790b7-96ce-448e-a0ae-9aac8bec595e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:31.077170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 198/385] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:30 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:31.077722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6634d-c24d-4e26-8db1-e0471e6715d1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.078009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6634d-c24d-4e26-8db1-e0471e6715d1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.078285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6634d-c24d-4e26-8db1-e0471e6715d1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.079828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 188/386] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:31.082139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c790b7-96ce-448e-a0ae-9aac8bec595e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:31.084710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf436cd-8d31-4d7b-80fd-1afea8a807c0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.085275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf436cd-8d31-4d7b-80fd-1afea8a807c0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.085545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf436cd-8d31-4d7b-80fd-1afea8a807c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.101245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:31.114071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ccf436cd-8d31-4d7b-80fd-1afea8a807c0 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:31.115265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ccf436cd-8d31-4d7b-80fd-1afea8a807c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:31.223963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 189/387] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:31.241363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c790b7-96ce-448e-a0ae-9aac8bec595e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:31.265086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:31.277765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ff53c-92c5-419c-a9c1-942d2f2e81b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:31.278401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ff53c-92c5-419c-a9c1-942d2f2e81b9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.278680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ff53c-92c5-419c-a9c1-942d2f2e81b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.278942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ff53c-92c5-419c-a9c1-942d2f2e81b9 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.280058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ff53c-92c5-419c-a9c1-942d2f2e81b9 None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:31.281533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ff53c-92c5-419c-a9c1-942d2f2e81b9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:31.283445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 199/388] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:31 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:31.289415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf436cd-8d31-4d7b-80fd-1afea8a807c0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:31.415230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf436cd-8d31-4d7b-80fd-1afea8a807c0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:31.459287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b83b82-2d89-415e-8e78-e8fc76c87318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:31.459967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83b82-2d89-415e-8e78-e8fc76c87318 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.460243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83b82-2d89-415e-8e78-e8fc76c87318 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.460515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b83b82-2d89-415e-8e78-e8fc76c87318 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329/groups/b081525e708a4c69808df1d0f3296889/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.462523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b83b82-2d89-415e-8e78-e8fc76c87318 None admin] RBAC: Authorizing `identity:create_grant(project_id=0229e1f6c84e43d0ab052db94ab62329, group_id=b081525e708a4c69808df1d0f3296889, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:31.463954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b83b82-2d89-415e-8e78-e8fc76c87318 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:31.467629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:31.481722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 190/389] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Oct 10 11:46:31 2022] PUT /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329/groups/b081525e708a4c69808df1d0f3296889/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:31.588447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ff53c-92c5-419c-a9c1-942d2f2e81b9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:31.719409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ff53c-92c5-419c-a9c1-942d2f2e81b9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:31.741264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513ebd1-07c7-4391-aac0-06b314a012e2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.741600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513ebd1-07c7-4391-aac0-06b314a012e2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.741809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513ebd1-07c7-4391-aac0-06b314a012e2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.743299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 191/390] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:31.749019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe28a4-1179-4134-9a08-3f52e2c486d7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.752590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe28a4-1179-4134-9a08-3f52e2c486d7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.752590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe28a4-1179-4134-9a08-3f52e2c486d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.770972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d93ce-1233-44d7-956e-3b9281070b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:31.771605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d93ce-1233-44d7-956e-3b9281070b54 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:31.771880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d93ce-1233-44d7-956e-3b9281070b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:31.772145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d93ce-1233-44d7-956e-3b9281070b54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:31.784648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d93ce-1233-44d7-956e-3b9281070b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-843d93ce-1233-44d7-956e-3b9281070b54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:31.791242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:31.792205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:31.793041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 200/391] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:31.795274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-70fe28a4-1179-4134-9a08-3f52e2c486d7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:31.796718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70fe28a4-1179-4134-9a08-3f52e2c486d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:31.798211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d93ce-1233-44d7-956e-3b9281070b54 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:31.885618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:31.926889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 192/392] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:31.956261 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d93ce-1233-44d7-956e-3b9281070b54 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:32.008594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827490a1-2978-4888-a242-0e6b14d1abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:32.009461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827490a1-2978-4888-a242-0e6b14d1abbe None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.009909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827490a1-2978-4888-a242-0e6b14d1abbe None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.010341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827490a1-2978-4888-a242-0e6b14d1abbe None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.011176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827490a1-2978-4888-a242-0e6b14d1abbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:32.011627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827490a1-2978-4888-a242-0e6b14d1abbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:32.013179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827490a1-2978-4888-a242-0e6b14d1abbe None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:32.025030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 201/393] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:32.030850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe28a4-1179-4134-9a08-3f52e2c486d7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:32.042671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f5cf9-f4da-4076-8616-4f14f0e3941d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.043187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f5cf9-f4da-4076-8616-4f14f0e3941d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.043619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f5cf9-f4da-4076-8616-4f14f0e3941d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.045409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 202/394] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:32.050521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065337-224c-453e-bcae-af31b4b4dead None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.051068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065337-224c-453e-bcae-af31b4b4dead None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.051525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065337-224c-453e-bcae-af31b4b4dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.079581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9f065337-224c-453e-bcae-af31b4b4dead None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:32.083869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9f065337-224c-453e-bcae-af31b4b4dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:32.210990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe28a4-1179-4134-9a08-3f52e2c486d7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:32.215607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 203/395] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:32.253333 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:32.262096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e8ed1-3419-42dd-830a-06486da85eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:32.262953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8ed1-3419-42dd-830a-06486da85eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.263409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8ed1-3419-42dd-830a-06486da85eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.263854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e8ed1-3419-42dd-830a-06486da85eb8 None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.270324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e8ed1-3419-42dd-830a-06486da85eb8 None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:32.272015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e8ed1-3419-42dd-830a-06486da85eb8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:32.273813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 193/396] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:32 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:32.279399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065337-224c-453e-bcae-af31b4b4dead None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:32.296351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e8ed1-3419-42dd-830a-06486da85eb8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:32.355790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:32.438876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e8ed1-3419-42dd-830a-06486da85eb8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:32.453237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065337-224c-453e-bcae-af31b4b4dead None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:32.505686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eadee-eaea-48a0-af10-17aed1502a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:32.506327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eadee-eaea-48a0-af10-17aed1502a76 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.506846 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eadee-eaea-48a0-af10-17aed1502a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.507124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eadee-eaea-48a0-af10-17aed1502a76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.512316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b87b6-af77-416e-b49d-ef9fbbc58966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:32.512894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b87b6-af77-416e-b49d-ef9fbbc58966 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.513213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b87b6-af77-416e-b49d-ef9fbbc58966 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.513484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b87b6-af77-416e-b49d-ef9fbbc58966 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.514595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b87b6-af77-416e-b49d-ef9fbbc58966 None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:32.516033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b87b6-af77-416e-b49d-ef9fbbc58966 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:32.522538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 204/397] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:32 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:32.522538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b87b6-af77-416e-b49d-ef9fbbc58966 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:32.522765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eadee-eaea-48a0-af10-17aed1502a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-937eadee-eaea-48a0-af10-17aed1502a76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:32.527170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:32.528061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:32.529281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 194/398] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:32.533542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eadee-eaea-48a0-af10-17aed1502a76 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:32.601260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:32.648328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b87b6-af77-416e-b49d-ef9fbbc58966 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:32.654769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eadee-eaea-48a0-af10-17aed1502a76 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:32.661730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:32.685201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e0370-79f6-407d-a3b1-74ffcd793e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:32.686051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e0370-79f6-407d-a3b1-74ffcd793e11 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.686500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e0370-79f6-407d-a3b1-74ffcd793e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.686923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e0370-79f6-407d-a3b1-74ffcd793e11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.695180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129a25-506b-49a6-98e6-612b5f0dcad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:32.695968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129a25-506b-49a6-98e6-612b5f0dcad5 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.696346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129a25-506b-49a6-98e6-612b5f0dcad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.696766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129a25-506b-49a6-98e6-612b5f0dcad5 None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329/groups/b081525e708a4c69808df1d0f3296889/roles/6c35be71800f4fd791345d48ca3f6ed2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.698976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e0370-79f6-407d-a3b1-74ffcd793e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:32.699091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61129a25-506b-49a6-98e6-612b5f0dcad5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0229e1f6c84e43d0ab052db94ab62329, group_id=b081525e708a4c69808df1d0f3296889, role_id=6c35be71800f4fd791345d48ca3f6ed2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:32.700635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61129a25-506b-49a6-98e6-612b5f0dcad5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c37e0370-79f6-407d-a3b1-74ffcd793e11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:32.704180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:32.705113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:32.706310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:32.711798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 205/399] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:32.711798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e0370-79f6-407d-a3b1-74ffcd793e11 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:32.729508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 195/400] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Oct 10 11:46:32 2022] PUT /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329/groups/b081525e708a4c69808df1d0f3296889/roles/6c35be71800f4fd791345d48ca3f6ed2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:32.730524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129a25-506b-49a6-98e6-612b5f0dcad5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:32.879239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129a25-506b-49a6-98e6-612b5f0dcad5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:32.897848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e0370-79f6-407d-a3b1-74ffcd793e11 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:32.918217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:32.940053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98d870-39d4-49a7-834c-b10a9b510859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:32.941592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98d870-39d4-49a7-834c-b10a9b510859 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.942384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98d870-39d4-49a7-834c-b10a9b510859 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.942883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98d870-39d4-49a7-834c-b10a9b510859 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.943773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98d870-39d4-49a7-834c-b10a9b510859 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:32.944330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98d870-39d4-49a7-834c-b10a9b510859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:32.944571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5dc0f-481d-4e50-97c6-4327ece3a65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:32.945237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dc0f-481d-4e50-97c6-4327ece3a65d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.945515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dc0f-481d-4e50-97c6-4327ece3a65d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.945785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dc0f-481d-4e50-97c6-4327ece3a65d None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.946454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5dc0f-481d-4e50-97c6-4327ece3a65d None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:32.946751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5dc0f-481d-4e50-97c6-4327ece3a65d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:32.947299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98d870-39d4-49a7-834c-b10a9b510859 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:32.948141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5dc0f-481d-4e50-97c6-4327ece3a65d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:32.957578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 196/402] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:32.957761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 206/402] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:32.959146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314413-a0c4-48a0-920b-9e14d474e44f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.959430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314413-a0c4-48a0-920b-9e14d474e44f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.959700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314413-a0c4-48a0-920b-9e14d474e44f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.961007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 207/403] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:32.966388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fce12-c20e-430a-b9b2-cb9dd759c50a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:32.966536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314413-a0c4-48a0-920b-9e14d474e44f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:32.966723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fce12-c20e-430a-b9b2-cb9dd759c50a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:32.966942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fce12-c20e-430a-b9b2-cb9dd759c50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:32.987245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-502fce12-c20e-430a-b9b2-cb9dd759c50a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:32.989039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-502fce12-c20e-430a-b9b2-cb9dd759c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:33.010725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:33.066654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 197/404] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:33.067433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fce12-c20e-430a-b9b2-cb9dd759c50a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:33.102739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314413-a0c4-48a0-920b-9e14d474e44f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:33.138848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd071198-8d9e-45e8-a737-89a55b851909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:33.139489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd071198-8d9e-45e8-a737-89a55b851909 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.139796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd071198-8d9e-45e8-a737-89a55b851909 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.140066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd071198-8d9e-45e8-a737-89a55b851909 None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.141305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd071198-8d9e-45e8-a737-89a55b851909 None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:33.142804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd071198-8d9e-45e8-a737-89a55b851909 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:33.145438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 208/405] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:32 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:33.154077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd071198-8d9e-45e8-a737-89a55b851909 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:33.255417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fce12-c20e-430a-b9b2-cb9dd759c50a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:33.277391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:33.327527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd071198-8d9e-45e8-a737-89a55b851909 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:33.330118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:33.340669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f56f-8e5b-4e61-b448-495589d0371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:33.341392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f56f-8e5b-4e61-b448-495589d0371f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.341674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f56f-8e5b-4e61-b448-495589d0371f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.341946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f56f-8e5b-4e61-b448-495589d0371f None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.343699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046f56f-8e5b-4e61-b448-495589d0371f None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:33.345171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046f56f-8e5b-4e61-b448-495589d0371f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:33.347071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 198/406] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:33 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:33.356136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f56f-8e5b-4e61-b448-495589d0371f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:33.379756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f73a1-7c14-4fc6-a8d7-278a7e400a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:33.380839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f73a1-7c14-4fc6-a8d7-278a7e400a39 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.381376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f73a1-7c14-4fc6-a8d7-278a7e400a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.381955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f73a1-7c14-4fc6-a8d7-278a7e400a39 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.383301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f73a1-7c14-4fc6-a8d7-278a7e400a39 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:33.385088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f73a1-7c14-4fc6-a8d7-278a7e400a39 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:33.387304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 209/407] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:33 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:33.388387 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f73a1-7c14-4fc6-a8d7-278a7e400a39 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:33.474574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f56f-8e5b-4e61-b448-495589d0371f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:33.512562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a8626-9c19-4fde-9415-351e9dd60515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:33.513229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a8626-9c19-4fde-9415-351e9dd60515 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.513525 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a8626-9c19-4fde-9415-351e9dd60515 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.513823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a8626-9c19-4fde-9415-351e9dd60515 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.514932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a8626-9c19-4fde-9415-351e9dd60515 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:33.516894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a8626-9c19-4fde-9415-351e9dd60515 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:33.518966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 199/408] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:33 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:33.519606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a8626-9c19-4fde-9415-351e9dd60515 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:33.523788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f73a1-7c14-4fc6-a8d7-278a7e400a39 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:33.571725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048948a4-f4a1-4f2c-a355-930763ca6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:33.573222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048948a4-f4a1-4f2c-a355-930763ca6376 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.574153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:33.574946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048948a4-f4a1-4f2c-a355-930763ca6376 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.575654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048948a4-f4a1-4f2c-a355-930763ca6376 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.591543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048948a4-f4a1-4f2c-a355-930763ca6376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-048948a4-f4a1-4f2c-a355-930763ca6376 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:33.599530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:33.600436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:33.601283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:33.609774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 210/409] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:33.610622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048948a4-f4a1-4f2c-a355-930763ca6376 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:33.652313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:33.655397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a8626-9c19-4fde-9415-351e9dd60515 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:33.699851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9129b5-b14f-4199-8e35-63a88a0d032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:33.700522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9129b5-b14f-4199-8e35-63a88a0d032f None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.700796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9129b5-b14f-4199-8e35-63a88a0d032f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.701095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9129b5-b14f-4199-8e35-63a88a0d032f None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251/groups/b081525e708a4c69808df1d0f3296889/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.703891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9129b5-b14f-4199-8e35-63a88a0d032f None admin] RBAC: Authorizing `identity:create_grant(project_id=94affdd6cbf542aa881f7f689c9d1251, group_id=b081525e708a4c69808df1d0f3296889, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:33.705587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9129b5-b14f-4199-8e35-63a88a0d032f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:33.724928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 200/410] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Oct 10 11:46:33 2022] PUT /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251/groups/b081525e708a4c69808df1d0f3296889/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:33.726181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9129b5-b14f-4199-8e35-63a88a0d032f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:33.746677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048948a4-f4a1-4f2c-a355-930763ca6376 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:33.788225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0cc46-6786-4335-81b0-931bb56ffaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:33.789427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cc46-6786-4335-81b0-931bb56ffaf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.790038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cc46-6786-4335-81b0-931bb56ffaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.790569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cc46-6786-4335-81b0-931bb56ffaf5 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251/groups/b081525e708a4c69808df1d0f3296889/roles/6c35be71800f4fd791345d48ca3f6ed2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.793392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0cc46-6786-4335-81b0-931bb56ffaf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=94affdd6cbf542aa881f7f689c9d1251, group_id=b081525e708a4c69808df1d0f3296889, role_id=6c35be71800f4fd791345d48ca3f6ed2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:33.795127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0cc46-6786-4335-81b0-931bb56ffaf5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:33.824714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 211/411] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Oct 10 11:46:33 2022] PUT /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251/groups/b081525e708a4c69808df1d0f3296889/roles/6c35be71800f4fd791345d48ca3f6ed2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:33.868781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9129b5-b14f-4199-8e35-63a88a0d032f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:33.871037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:33.929599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:33.930602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:33.931099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:33.931580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:33.932458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:33.932999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:33.934607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:33.950183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 201/412] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:33.956561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0cc46-6786-4335-81b0-931bb56ffaf5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:34.078485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:34.091495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0cc46-6786-4335-81b0-931bb56ffaf5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:34.133109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc9e45-25c9-41ec-907c-0b5b6be870ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:34.133570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc9e45-25c9-41ec-907c-0b5b6be870ac None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.133853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc9e45-25c9-41ec-907c-0b5b6be870ac None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.134129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc9e45-25c9-41ec-907c-0b5b6be870ac None admin] PATH_INFO: `/v3/groups/2b9c9c343e04400cbe0c9985ee948f09` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.135262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc9e45-25c9-41ec-907c-0b5b6be870ac None admin] RBAC: Authorizing `identity:get_group(group_id=2b9c9c343e04400cbe0c9985ee948f09)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:34.136724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc9e45-25c9-41ec-907c-0b5b6be870ac None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:34.138792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 212/413] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:33 2022] GET /identity/v3/groups/2b9c9c343e04400cbe0c9985ee948f09 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:34.144826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:34.202897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a290-b6e5-441e-a95f-1b06c13bc8cd None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.203198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a290-b6e5-441e-a95f-1b06c13bc8cd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.203452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a290-b6e5-441e-a95f-1b06c13bc8cd None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.205548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 213/414] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:34.217925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef80b8-fead-4556-b637-80dbea6e0a7a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.218708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef80b8-fead-4556-b637-80dbea6e0a7a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.219107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef80b8-fead-4556-b637-80dbea6e0a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.249997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0cef80b8-fead-4556-b637-80dbea6e0a7a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:34.251476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0cef80b8-fead-4556-b637-80dbea6e0a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:34.264281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a73f5-e0a7-471d-9151-d389baf43fb3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:34.310428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fba66-e894-4ff7-858c-f203e22ab424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:34.311071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fba66-e894-4ff7-858c-f203e22ab424 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.311354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fba66-e894-4ff7-858c-f203e22ab424 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.311628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fba66-e894-4ff7-858c-f203e22ab424 None admin] PATH_INFO: `/v3/projects/46b9ca29061a40d98972b8db835132e5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.313257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fba66-e894-4ff7-858c-f203e22ab424 None admin] RBAC: Authorizing `identity:get_project(project_id=46b9ca29061a40d98972b8db835132e5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:34.314702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fba66-e894-4ff7-858c-f203e22ab424 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:34.316334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 202/415] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:34 2022] GET /identity/v3/projects/46b9ca29061a40d98972b8db835132e5 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:34.328104 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fba66-e894-4ff7-858c-f203e22ab424 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:34.364213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 214/416] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:34.377481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:34.456921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fba66-e894-4ff7-858c-f203e22ab424 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:34.499943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645a0f2-4895-4f28-9e96-53454fb8d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:34.500610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645a0f2-4895-4f28-9e96-53454fb8d99a None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.500881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645a0f2-4895-4f28-9e96-53454fb8d99a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.501175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645a0f2-4895-4f28-9e96-53454fb8d99a None admin] PATH_INFO: `/v3/projects/46b9ca29061a40d98972b8db835132e5/groups/2b9c9c343e04400cbe0c9985ee948f09/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.503337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645a0f2-4895-4f28-9e96-53454fb8d99a None admin] RBAC: Authorizing `identity:create_grant(project_id=46b9ca29061a40d98972b8db835132e5, group_id=2b9c9c343e04400cbe0c9985ee948f09, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:34.505338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645a0f2-4895-4f28-9e96-53454fb8d99a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:34.528745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 203/417] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Oct 10 11:46:34 2022] PUT /identity/v3/projects/46b9ca29061a40d98972b8db835132e5/groups/2b9c9c343e04400cbe0c9985ee948f09/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:34.682017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef80b8-fead-4556-b637-80dbea6e0a7a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:34.794378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:34.808568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef80b8-fead-4556-b637-80dbea6e0a7a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:34.861808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793e836-ee33-4ad9-881e-131000e9887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:34.862448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e836-ee33-4ad9-881e-131000e9887d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:34.865374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e836-ee33-4ad9-881e-131000e9887d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:34.865693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793e836-ee33-4ad9-881e-131000e9887d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:34.883311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793e836-ee33-4ad9-881e-131000e9887d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d793e836-ee33-4ad9-881e-131000e9887d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:34.888125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:34.889048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:34.890493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 215/418] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:34.895616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645a0f2-4895-4f28-9e96-53454fb8d99a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.005619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.016895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645a0f2-4895-4f28-9e96-53454fb8d99a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.064048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0943bb-5a3f-4c50-ad30-29ad244af495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.064876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0943bb-5a3f-4c50-ad30-29ad244af495 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.065313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0943bb-5a3f-4c50-ad30-29ad244af495 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.065744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0943bb-5a3f-4c50-ad30-29ad244af495 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.066535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0943bb-5a3f-4c50-ad30-29ad244af495 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:35.067509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0943bb-5a3f-4c50-ad30-29ad244af495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.069007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0943bb-5a3f-4c50-ad30-29ad244af495 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.077606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 204/419] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:35.086036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793e836-ee33-4ad9-881e-131000e9887d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.235645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793e836-ee33-4ad9-881e-131000e9887d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.276597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a395d-7f4d-4132-a28a-f71d0d7ce98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.277226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a395d-7f4d-4132-a28a-f71d0d7ce98e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.277502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a395d-7f4d-4132-a28a-f71d0d7ce98e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.277771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a395d-7f4d-4132-a28a-f71d0d7ce98e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.305525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.335559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a65d9-279e-4d56-99e2-b980c14d680a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.336153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a65d9-279e-4d56-99e2-b980c14d680a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.336651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a65d9-279e-4d56-99e2-b980c14d680a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.338321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 205/420] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:35.343773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49709146-a369-4667-9357-9c758f03744f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.344060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49709146-a369-4667-9357-9c758f03744f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.344332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49709146-a369-4667-9357-9c758f03744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.379269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a395d-7f4d-4132-a28a-f71d0d7ce98e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.380963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a395d-7f4d-4132-a28a-f71d0d7ce98e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.383774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-49709146-a369-4667-9357-9c758f03744f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:35.385141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-49709146-a369-4667-9357-9c758f03744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:35.507972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 206/421] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:35.543409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 216/422] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:35.550069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49709146-a369-4667-9357-9c758f03744f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.665428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.683629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49709146-a369-4667-9357-9c758f03744f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.724536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526c580-250f-4a22-9dc7-6a2bd38a69ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.725199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526c580-250f-4a22-9dc7-6a2bd38a69ea None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.725479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526c580-250f-4a22-9dc7-6a2bd38a69ea None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.725751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526c580-250f-4a22-9dc7-6a2bd38a69ea None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.726897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526c580-250f-4a22-9dc7-6a2bd38a69ea None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.728326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526c580-250f-4a22-9dc7-6a2bd38a69ea None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.730917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 207/423] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:35.735383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a395d-7f4d-4132-a28a-f71d0d7ce98e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.794105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:35.872758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a395d-7f4d-4132-a28a-f71d0d7ce98e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:35.896399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526c580-250f-4a22-9dc7-6a2bd38a69ea None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:35.909380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0dd08-19b3-458d-8cf2-40b900b0a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:35.910122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0dd08-19b3-458d-8cf2-40b900b0a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:35.910408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0dd08-19b3-458d-8cf2-40b900b0a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:35.910718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0dd08-19b3-458d-8cf2-40b900b0a1a0 None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:35.911944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0dd08-19b3-458d-8cf2-40b900b0a1a0 None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:35.913556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0dd08-19b3-458d-8cf2-40b900b0a1a0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:35.915291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 217/424] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:35.920925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0dd08-19b3-458d-8cf2-40b900b0a1a0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.045885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0dd08-19b3-458d-8cf2-40b900b0a1a0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.073488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526c580-250f-4a22-9dc7-6a2bd38a69ea None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.091300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.110651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f980-d33b-492e-9c42-b3fe06b352ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.111285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f980-d33b-492e-9c42-b3fe06b352ad None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.111571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f980-d33b-492e-9c42-b3fe06b352ad None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.111848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f980-d33b-492e-9c42-b3fe06b352ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.117657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.118483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.118988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.119451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.120377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] RBAC: Adding query filter params (group.id=b081525e708a4c69808df1d0f3296889, role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=0229e1f6c84e43d0ab052db94ab62329) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:36.120871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:36.122526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:36.122652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9f980-d33b-492e-9c42-b3fe06b352ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ada9f980-d33b-492e-9c42-b3fe06b352ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:36.128094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:36.128955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:36.130492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 208/425] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:36.135039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 218/426] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:35 2022] GET /identity/v3/role_assignments?group.id=b081525e708a4c69808df1d0f3296889&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=51dbfe81239845968f102b6b956c7061 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:36.135868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f980-d33b-492e-9c42-b3fe06b352ad None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.153033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.249393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f980-d33b-492e-9c42-b3fe06b352ad None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.291828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c87a08-8c67-4217-b0f5-dba10af00494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.292461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c87a08-8c67-4217-b0f5-dba10af00494 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.292733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c87a08-8c67-4217-b0f5-dba10af00494 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.293052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c87a08-8c67-4217-b0f5-dba10af00494 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.293734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c87a08-8c67-4217-b0f5-dba10af00494 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:36.294042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c87a08-8c67-4217-b0f5-dba10af00494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:36.295425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c87a08-8c67-4217-b0f5-dba10af00494 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:36.309887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 209/427] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:36.315340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.432667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13add963-c842-4489-a534-2e50fa6b6ef2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.476430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e53fb-685c-4c22-8e39-f262e63d27ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.477124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e53fb-685c-4c22-8e39-f262e63d27ae None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.477411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e53fb-685c-4c22-8e39-f262e63d27ae None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.477683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e53fb-685c-4c22-8e39-f262e63d27ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.512330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfaec0-392a-4949-9445-40e7bdad251d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.512671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfaec0-392a-4949-9445-40e7bdad251d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.512999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfaec0-392a-4949-9445-40e7bdad251d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.514741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 210/428] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:36.521482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea67e-5b59-4cb3-9190-b24f6978dee2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.521764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea67e-5b59-4cb3-9190-b24f6978dee2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.522041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ea67e-5b59-4cb3-9190-b24f6978dee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.537549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.544158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2f4ea67e-5b59-4cb3-9190-b24f6978dee2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:36.545684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2f4ea67e-5b59-4cb3-9190-b24f6978dee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:36.562273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e53fb-685c-4c22-8e39-f262e63d27ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:36.563739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e53fb-685c-4c22-8e39-f262e63d27ae None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:36.632963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 211/429] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:36.633376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7ddf-2603-4fc8-ac21-4164b851f837 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.633658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7ddf-2603-4fc8-ac21-4164b851f837 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.633930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7ddf-2603-4fc8-ac21-4164b851f837 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.635289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 212/430] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:36.640407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e521fc-0a4d-4aaf-8e93-ede5318c55ec None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.640688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e521fc-0a4d-4aaf-8e93-ede5318c55ec None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.640960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e521fc-0a4d-4aaf-8e93-ede5318c55ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.649346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.662145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b0e521fc-0a4d-4aaf-8e93-ede5318c55ec None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:36.662883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b0e521fc-0a4d-4aaf-8e93-ede5318c55ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:36.679757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 219/431] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:36.681306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e53fb-685c-4c22-8e39-f262e63d27ae None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.749961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 213/432] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:36.779338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:36.804308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e53fb-685c-4c22-8e39-f262e63d27ae None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:36.846585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b856c-62bb-43af-a221-8009b5e9b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:36.847220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b856c-62bb-43af-a221-8009b5e9b51e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:36.847494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b856c-62bb-43af-a221-8009b5e9b51e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:36.847764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b856c-62bb-43af-a221-8009b5e9b51e None admin] PATH_INFO: `/v3/projects/0229e1f6c84e43d0ab052db94ab62329` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:36.848899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b856c-62bb-43af-a221-8009b5e9b51e None admin] RBAC: Authorizing `identity:get_project(project_id=0229e1f6c84e43d0ab052db94ab62329)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:36.850411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b856c-62bb-43af-a221-8009b5e9b51e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:36.852311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 220/433] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/projects/0229e1f6c84e43d0ab052db94ab62329 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:36.858066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e521fc-0a4d-4aaf-8e93-ede5318c55ec None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.969984 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b856c-62bb-43af-a221-8009b5e9b51e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:36.990645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e521fc-0a4d-4aaf-8e93-ede5318c55ec None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.041400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5e1d-6b83-4805-b5ff-fb7c7dca1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.041957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5e1d-6b83-4805-b5ff-fb7c7dca1b32 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.042518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5e1d-6b83-4805-b5ff-fb7c7dca1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.042796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb5e1d-6b83-4805-b5ff-fb7c7dca1b32 None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.043931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5e1d-6b83-4805-b5ff-fb7c7dca1b32 None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.045397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb5e1d-6b83-4805-b5ff-fb7c7dca1b32 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.048544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 214/434] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:37.053561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5e1d-6b83-4805-b5ff-fb7c7dca1b32 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.065340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.104898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b856c-62bb-43af-a221-8009b5e9b51e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.140742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603f7c-f5ed-4dbb-8cfa-185b0a46552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.141398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603f7c-f5ed-4dbb-8cfa-185b0a46552b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.141670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603f7c-f5ed-4dbb-8cfa-185b0a46552b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.141936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1603f7c-f5ed-4dbb-8cfa-185b0a46552b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.153102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1603f7c-f5ed-4dbb-8cfa-185b0a46552b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f1603f7c-f5ed-4dbb-8cfa-185b0a46552b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:37.157897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:37.158847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:37.159701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 221/435] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:37.160419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603f7c-f5ed-4dbb-8cfa-185b0a46552b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.172612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.175036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb5e1d-6b83-4805-b5ff-fb7c7dca1b32 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.213025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.213885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.214167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.214444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.215164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] RBAC: Adding query filter params (group.id=b081525e708a4c69808df1d0f3296889, role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=0229e1f6c84e43d0ab052db94ab62329) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:37.215497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.216901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.233182 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 215/436] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/role_assignments?group.id=b081525e708a4c69808df1d0f3296889&scope.project.id=0229e1f6c84e43d0ab052db94ab62329&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:37.234163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.288038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1603f7c-f5ed-4dbb-8cfa-185b0a46552b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.329364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.342860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba1ab-dee2-49f8-9e2e-a48bd6e5f79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.342860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba1ab-dee2-49f8-9e2e-a48bd6e5f79c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.343321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba1ab-dee2-49f8-9e2e-a48bd6e5f79c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.343696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba1ab-dee2-49f8-9e2e-a48bd6e5f79c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.356792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba1ab-dee2-49f8-9e2e-a48bd6e5f79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-066ba1ab-dee2-49f8-9e2e-a48bd6e5f79c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:37.361948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:37.363140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 10 11:46:37.364733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:37.366412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 222/437] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:37.372415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba1ab-dee2-49f8-9e2e-a48bd6e5f79c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.385656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44095d-c32c-4ee5-913f-c3dfac378753 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.423841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.424723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.425035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.425312 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.425980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:37.426859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.428276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.438318 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 216/438] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:37.444772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.447970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.490443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba1ab-dee2-49f8-9e2e-a48bd6e5f79c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.528509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36340a79-feb6-45df-b13b-80c9e4d5caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.529157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36340a79-feb6-45df-b13b-80c9e4d5caa8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.529435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36340a79-feb6-45df-b13b-80c9e4d5caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.529702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36340a79-feb6-45df-b13b-80c9e4d5caa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.530361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36340a79-feb6-45df-b13b-80c9e4d5caa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:37.530667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36340a79-feb6-45df-b13b-80c9e4d5caa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.532171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36340a79-feb6-45df-b13b-80c9e4d5caa8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.542455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 223/439] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:37.543776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92b87-5d73-455b-899c-22e595b587ed None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.544058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92b87-5d73-455b-899c-22e595b587ed None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.544329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92b87-5d73-455b-899c-22e595b587ed None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.545807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 224/440] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:37.547863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db92b87-5d73-455b-899c-22e595b587ed None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.560849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba9b33-8510-49a7-acc6-1402e2be0992 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.590550 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.601280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003bbca-6d7f-4b81-9009-9d903893380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.601916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bbca-6d7f-4b81-9009-9d903893380e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.602191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bbca-6d7f-4b81-9009-9d903893380e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.602456 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003bbca-6d7f-4b81-9009-9d903893380e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.662121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db92b87-5d73-455b-899c-22e595b587ed None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.685294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003bbca-6d7f-4b81-9009-9d903893380e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.686723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003bbca-6d7f-4b81-9009-9d903893380e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.689925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.695985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6206-e0c1-4352-8541-93c851746aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:37.696584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6206-e0c1-4352-8541-93c851746aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.696864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6206-e0c1-4352-8541-93c851746aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.697170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6206-e0c1-4352-8541-93c851746aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.762803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af6206-e0c1-4352-8541-93c851746aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:37.764251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af6206-e0c1-4352-8541-93c851746aa4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:37.782880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 217/441] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:37.784105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095746-4e12-4dfa-a420-efc6335e7fb5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:37.784383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095746-4e12-4dfa-a420-efc6335e7fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:37.784647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095746-4e12-4dfa-a420-efc6335e7fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:37.802372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7f095746-4e12-4dfa-a420-efc6335e7fb5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:37.803604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7f095746-4e12-4dfa-a420-efc6335e7fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:37.825745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.866588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 225/442] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:37.867352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6206-e0c1-4352-8541-93c851746aa4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.874423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 218/443] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:37.875241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f095746-4e12-4dfa-a420-efc6335e7fb5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:37.896815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:37.968044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6206-e0c1-4352-8541-93c851746aa4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:37.978183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f095746-4e12-4dfa-a420-efc6335e7fb5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.002838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13195-5970-4ad8-a400-82571ea51923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.003725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13195-5970-4ad8-a400-82571ea51923 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.004107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13195-5970-4ad8-a400-82571ea51923 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.004394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13195-5970-4ad8-a400-82571ea51923 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.005637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc13195-5970-4ad8-a400-82571ea51923 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.007187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc13195-5970-4ad8-a400-82571ea51923 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.012222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67328d7-b271-4c7a-b9fb-bb87d0a61c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.012853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67328d7-b271-4c7a-b9fb-bb87d0a61c80 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.013167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67328d7-b271-4c7a-b9fb-bb87d0a61c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.013681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 226/444] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.013778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67328d7-b271-4c7a-b9fb-bb87d0a61c80 None admin] PATH_INFO: `/v3/projects/94affdd6cbf542aa881f7f689c9d1251` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.014482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13195-5970-4ad8-a400-82571ea51923 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.014811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67328d7-b271-4c7a-b9fb-bb87d0a61c80 None admin] RBAC: Authorizing `identity:get_project(project_id=94affdd6cbf542aa881f7f689c9d1251)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.016244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67328d7-b271-4c7a-b9fb-bb87d0a61c80 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.017876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 219/445] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:37 2022] GET /identity/v3/projects/94affdd6cbf542aa881f7f689c9d1251 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.023513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67328d7-b271-4c7a-b9fb-bb87d0a61c80 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.051108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.120719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.124690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13195-5970-4ad8-a400-82571ea51923 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.125288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67328d7-b271-4c7a-b9fb-bb87d0a61c80 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.160114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b23e-613b-420e-a679-4642723da829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.160491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77107a9-c40d-479f-94f8-050323f6f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.160780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b23e-613b-420e-a679-4642723da829 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.161090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b23e-613b-420e-a679-4642723da829 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.161181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77107a9-c40d-479f-94f8-050323f6f5ed None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.161368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983b23e-613b-420e-a679-4642723da829 None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.161458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77107a9-c40d-479f-94f8-050323f6f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.161691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77107a9-c40d-479f-94f8-050323f6f5ed None admin] PATH_INFO: `/v3/groups/b081525e708a4c69808df1d0f3296889` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.162475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983b23e-613b-420e-a679-4642723da829 None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.162789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77107a9-c40d-479f-94f8-050323f6f5ed None admin] RBAC: Authorizing `identity:get_group(group_id=b081525e708a4c69808df1d0f3296889)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.164083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983b23e-613b-420e-a679-4642723da829 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.164189 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77107a9-c40d-479f-94f8-050323f6f5ed None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.165940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 227/447] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.166045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 220/447] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/groups/b081525e708a4c69808df1d0f3296889 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:38.166495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b23e-613b-420e-a679-4642723da829 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.173875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77107a9-c40d-479f-94f8-050323f6f5ed None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.261758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983b23e-613b-420e-a679-4642723da829 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.265851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.273754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77107a9-c40d-479f-94f8-050323f6f5ed None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.294819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f55fd-9bfc-4ccd-a2ee-7ee29e41004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.295434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f55fd-9bfc-4ccd-a2ee-7ee29e41004f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.295706 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f55fd-9bfc-4ccd-a2ee-7ee29e41004f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.295970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f55fd-9bfc-4ccd-a2ee-7ee29e41004f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.305766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f55fd-9bfc-4ccd-a2ee-7ee29e41004f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:38.307076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.307670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.307949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.308221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.308928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] RBAC: Adding query filter params (group.id=b081525e708a4c69808df1d0f3296889, role.id=51dbfe81239845968f102b6b956c7061, scope.project.id=94affdd6cbf542aa881f7f689c9d1251) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:38.309261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-643f55fd-9bfc-4ccd-a2ee-7ee29e41004f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:38.310446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:38.311363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:46:38.312176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:38.313069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.313139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 228/448] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:38.313139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f55fd-9bfc-4ccd-a2ee-7ee29e41004f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.317945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 221/449] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/role_assignments?group.id=b081525e708a4c69808df1d0f3296889&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=51dbfe81239845968f102b6b956c7061 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.318725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.343200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.425310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f55fd-9bfc-4ccd-a2ee-7ee29e41004f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.455286 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0546dd2-a5ff-45f3-a6d0-de2e87b8c1a2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.463557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.464172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.464453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.464724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.465514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] RBAC: Adding query filter params (group.id=b081525e708a4c69808df1d0f3296889, role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=94affdd6cbf542aa881f7f689c9d1251) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:38.465824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.467310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.481001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 229/450] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/role_assignments?group.id=b081525e708a4c69808df1d0f3296889&scope.project.id=94affdd6cbf542aa881f7f689c9d1251&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.506473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.507103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.507381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.507654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.508332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:38.508633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.510115 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.520270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 222/451] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:38.526416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.638129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.650306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dcf46-f301-4616-b8eb-da9af19dae9a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.685276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1885a-f5b2-4337-bfd7-2d7f673a74b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.685796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1885a-f5b2-4337-bfd7-2d7f673a74b0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.686087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1885a-f5b2-4337-bfd7-2d7f673a74b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.686363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1885a-f5b2-4337-bfd7-2d7f673a74b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.757172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1885a-f5b2-4337-bfd7-2d7f673a74b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:38.758629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1885a-f5b2-4337-bfd7-2d7f673a74b0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:38.851261 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.861624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 230/452] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:38.867500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:38.890457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:38.965422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586614b9-1a60-4071-9ec3-a2bad9bdebf0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:38.996416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba078-8683-4957-8438-8f687d6c3c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:38.997052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba078-8683-4957-8438-8f687d6c3c39 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:38.997332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba078-8683-4957-8438-8f687d6c3c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:38.997600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba078-8683-4957-8438-8f687d6c3c39 None admin] PATH_INFO: `/v3/projects/46b9ca29061a40d98972b8db835132e5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:38.998686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ba078-8683-4957-8438-8f687d6c3c39 None admin] RBAC: Authorizing `identity:get_project(project_id=46b9ca29061a40d98972b8db835132e5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:39.000097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ba078-8683-4957-8438-8f687d6c3c39 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:39.001697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 223/453] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:46:38 2022] GET /identity/v3/projects/46b9ca29061a40d98972b8db835132e5 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:39.007983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1885a-f5b2-4337-bfd7-2d7f673a74b0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:39.101694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1885a-f5b2-4337-bfd7-2d7f673a74b0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:39.134072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487fd1-be70-4a71-bc2c-ff72a1e8bb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:39.134680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487fd1-be70-4a71-bc2c-ff72a1e8bb67 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:39.134958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487fd1-be70-4a71-bc2c-ff72a1e8bb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:39.135228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487fd1-be70-4a71-bc2c-ff72a1e8bb67 None admin] PATH_INFO: `/v3/groups/2b9c9c343e04400cbe0c9985ee948f09` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:39.136308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487fd1-be70-4a71-bc2c-ff72a1e8bb67 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9c9c343e04400cbe0c9985ee948f09)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:39.137792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487fd1-be70-4a71-bc2c-ff72a1e8bb67 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:39.139319 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 231/454] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 10 11:46:39 2022] GET /identity/v3/groups/2b9c9c343e04400cbe0c9985ee948f09 => generated 229 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:39.144840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba078-8683-4957-8438-8f687d6c3c39 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:39.228474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:39.240413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba078-8683-4957-8438-8f687d6c3c39 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:39.272278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292cfab5-c1a2-4cd9-869b-80a9a0aacaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:39.272866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cfab5-c1a2-4cd9-869b-80a9a0aacaba None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:39.273177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cfab5-c1a2-4cd9-869b-80a9a0aacaba None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:39.273450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292cfab5-c1a2-4cd9-869b-80a9a0aacaba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:39.274157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cfab5-c1a2-4cd9-869b-80a9a0aacaba None admin] RBAC: Adding query filter params (group.id=2b9c9c343e04400cbe0c9985ee948f09, role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=46b9ca29061a40d98972b8db835132e5) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:39.274463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cfab5-c1a2-4cd9-869b-80a9a0aacaba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:39.275859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292cfab5-c1a2-4cd9-869b-80a9a0aacaba None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:39.281368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 224/455] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 10 11:46:39 2022] GET /identity/v3/role_assignments?group.id=2b9c9c343e04400cbe0c9985ee948f09&scope.project.id=46b9ca29061a40d98972b8db835132e5&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:41.859524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92162ab-8f27-4e41-9826-27c273e64cdb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:41.860026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92162ab-8f27-4e41-9826-27c273e64cdb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:41.860100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92162ab-8f27-4e41-9826-27c273e64cdb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:41.861458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 232/456] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:41.877891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb596-df6e-4f49-9c20-7ae121ad75cf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:41.878636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb596-df6e-4f49-9c20-7ae121ad75cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:41.878709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fb596-df6e-4f49-9c20-7ae121ad75cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:41.906031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-989fb596-df6e-4f49-9c20-7ae121ad75cf None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:41.907248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-989fb596-df6e-4f49-9c20-7ae121ad75cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:42.006598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 225/457] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:42.073634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a6379-a9e7-4809-962d-9381ab40f038 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.074244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a6379-a9e7-4809-962d-9381ab40f038 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.074719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a6379-a9e7-4809-962d-9381ab40f038 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.076251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 233/458] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:42.081747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab935-bd84-474c-803a-b07db2abe0e5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.082281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab935-bd84-474c-803a-b07db2abe0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.082754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab935-bd84-474c-803a-b07db2abe0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.109961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3efab935-bd84-474c-803a-b07db2abe0e5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:42.111456 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3efab935-bd84-474c-803a-b07db2abe0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:42.194521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 226/459] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:42.289419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a6379-a9e7-4809-962d-9381ab40f038 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.367573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.426628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a6379-a9e7-4809-962d-9381ab40f038 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.469614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.470688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.470967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.471239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.482294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.483759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:42.503735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:42.504808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:42.506350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:42.506350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:42.506350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:42.506350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 234/460] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:42.510896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efab935-bd84-474c-803a-b07db2abe0e5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.529793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.537544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.646235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3e6b1-afff-4c45-b40b-940746d48ba2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.651862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efab935-bd84-474c-803a-b07db2abe0e5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.657335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.681240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c759c44-8caf-4a85-92fa-8834f4a7bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.681836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c759c44-8caf-4a85-92fa-8834f4a7bbef None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.682116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c759c44-8caf-4a85-92fa-8834f4a7bbef None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.682383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c759c44-8caf-4a85-92fa-8834f4a7bbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.689516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10920a6-f959-45e6-b255-cae5d24ad9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.690124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10920a6-f959-45e6-b255-cae5d24ad9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.690399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10920a6-f959-45e6-b255-cae5d24ad9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.691067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10920a6-f959-45e6-b255-cae5d24ad9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.691713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10920a6-f959-45e6-b255-cae5d24ad9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:42.692019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10920a6-f959-45e6-b255-cae5d24ad9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.693194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c759c44-8caf-4a85-92fa-8834f4a7bbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.693938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10920a6-f959-45e6-b255-cae5d24ad9b7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.694635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c759c44-8caf-4a85-92fa-8834f4a7bbef None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4c759c44-8caf-4a85-92fa-8834f4a7bbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:42.709068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:42.709978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:42.710852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:42.710852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:42.710852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:42.710852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 235/461] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:42.717020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 227/462] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:42.717020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1f9d-1921-4eed-a12d-f22898b99187 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.717020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1f9d-1921-4eed-a12d-f22898b99187 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.717020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a1f9d-1921-4eed-a12d-f22898b99187 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.717341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135c2a-4bbd-49e3-b80b-b73fe0457b2f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.717341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135c2a-4bbd-49e3-b80b-b73fe0457b2f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.717341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135c2a-4bbd-49e3-b80b-b73fe0457b2f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.717530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 228/463] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:42.718653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a1f9d-1921-4eed-a12d-f22898b99187 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.722200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 236/464] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:42.723110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44135c2a-4bbd-49e3-b80b-b73fe0457b2f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:42.798065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:42.836061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a1f9d-1921-4eed-a12d-f22898b99187 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.836405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44135c2a-4bbd-49e3-b80b-b73fe0457b2f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:42.870572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05884c9a-155f-4adb-9894-7fa7d60a97cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.871217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ca9be-bacb-45c2-b60c-960eb207ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:42.871441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884c9a-155f-4adb-9894-7fa7d60a97cf None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.871536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ca9be-bacb-45c2-b60c-960eb207ff5b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.871664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884c9a-155f-4adb-9894-7fa7d60a97cf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.871797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ca9be-bacb-45c2-b60c-960eb207ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.872046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ca9be-bacb-45c2-b60c-960eb207ff5b None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.872221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884c9a-155f-4adb-9894-7fa7d60a97cf None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.872687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ca9be-bacb-45c2-b60c-960eb207ff5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:42.872873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05884c9a-155f-4adb-9894-7fa7d60a97cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.873046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ca9be-bacb-45c2-b60c-960eb207ff5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:42.874346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05884c9a-155f-4adb-9894-7fa7d60a97cf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.874439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ca9be-bacb-45c2-b60c-960eb207ff5b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:42.893836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 229/465] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:42.893836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924704d-a18d-4b14-9275-97a621a27e24 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.893836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924704d-a18d-4b14-9275-97a621a27e24 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.893836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924704d-a18d-4b14-9275-97a621a27e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.902071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 237/466] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:42 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:42.906466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbd69-0582-4616-b175-012813b27521 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:42.906759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbd69-0582-4616-b175-012813b27521 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:42.907030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbd69-0582-4616-b175-012813b27521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:42.919440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a924704d-a18d-4b14-9275-97a621a27e24 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:42.920676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a924704d-a18d-4b14-9275-97a621a27e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:42.945918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b45dbd69-0582-4616-b175-012813b27521 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:42.947818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b45dbd69-0582-4616-b175-012813b27521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:42.966759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.000479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 230/467] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:43.001400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924704d-a18d-4b14-9275-97a621a27e24 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.041127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 238/468] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:43.067842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.109516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924704d-a18d-4b14-9275-97a621a27e24 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.148196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175e188-8651-4839-938d-612fe6961962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.148810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e188-8651-4839-938d-612fe6961962 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.149118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e188-8651-4839-938d-612fe6961962 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.149388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e188-8651-4839-938d-612fe6961962 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.150043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175e188-8651-4839-938d-612fe6961962 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.151489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175e188-8651-4839-938d-612fe6961962 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.176273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 231/469] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:43 2022] POST /identity/v3/users => generated 248 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:43.332615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dbd69-0582-4616-b175-012813b27521 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.388496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175e188-8651-4839-938d-612fe6961962 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.448647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dbd69-0582-4616-b175-012813b27521 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.488349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdc813-02a9-4db6-af73-979583cfea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.489003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdc813-02a9-4db6-af73-979583cfea69 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.489880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdc813-02a9-4db6-af73-979583cfea69 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.490154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdc813-02a9-4db6-af73-979583cfea69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.501556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdc813-02a9-4db6-af73-979583cfea69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.502580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175e188-8651-4839-938d-612fe6961962 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.503033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdc813-02a9-4db6-af73-979583cfea69 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.514503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.524491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d5bdc813-02a9-4db6-af73-979583cfea69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:43.525582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:43.526485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:43.528063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:43.528063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:43.528063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:43.528063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 239/470] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:43.530864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c369f1-9b8a-49cb-adf6-8e725c0cc393 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.530864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c369f1-9b8a-49cb-adf6-8e725c0cc393 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.530864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c369f1-9b8a-49cb-adf6-8e725c0cc393 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.530864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 240/471] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:43.534826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c369f1-9b8a-49cb-adf6-8e725c0cc393 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.556033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65f527-ae21-4fec-a404-c81b503c53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.557356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f527-ae21-4fec-a404-c81b503c53e0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.557735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f527-ae21-4fec-a404-c81b503c53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.558291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65f527-ae21-4fec-a404-c81b503c53e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.573583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f527-ae21-4fec-a404-c81b503c53e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.575128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65f527-ae21-4fec-a404-c81b503c53e0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1e65f527-ae21-4fec-a404-c81b503c53e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:43.595416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:43.597097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:43.599407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:43.599407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:43.599407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:43.599407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 232/472] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:43.603600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126a3b-af3d-44e8-8ef2-5435f93dfd6e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.603600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126a3b-af3d-44e8-8ef2-5435f93dfd6e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.603600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126a3b-af3d-44e8-8ef2-5435f93dfd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.628997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-82126a3b-af3d-44e8-8ef2-5435f93dfd6e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:43.630227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-82126a3b-af3d-44e8-8ef2-5435f93dfd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:43.659414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c369f1-9b8a-49cb-adf6-8e725c0cc393 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.699502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.700034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.700312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.700636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.701375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:43.701676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.703111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.717107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 241/473] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:43.717974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.728162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 233/474] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:43.728820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126a3b-af3d-44e8-8ef2-5435f93dfd6e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:43.792737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:43.843240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d67af-9cce-446d-a687-259749efed24 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:43.882131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:43.882744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:43.883005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:43.883281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:43.883928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:43.884230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:43.885633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:43.903420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 242/475] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:43.904601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.016063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:44.021237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126a3b-af3d-44e8-8ef2-5435f93dfd6e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.026639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6769d5f-6bad-4e6b-a3e4-57b1bb1976ff None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.065315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395e4c1-6847-4e6b-8fe0-bd1ca3348cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.066195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e4c1-6847-4e6b-8fe0-bd1ca3348cd0 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.066652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e4c1-6847-4e6b-8fe0-bd1ca3348cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.067080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395e4c1-6847-4e6b-8fe0-bd1ca3348cd0 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.067209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:44.068324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395e4c1-6847-4e6b-8fe0-bd1ca3348cd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.069875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395e4c1-6847-4e6b-8fe0-bd1ca3348cd0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.075405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0900cd-0272-43b4-8f4d-99da6f035168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.076252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0900cd-0272-43b4-8f4d-99da6f035168 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.076717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0900cd-0272-43b4-8f4d-99da6f035168 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.077191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0900cd-0272-43b4-8f4d-99da6f035168 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.078010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0900cd-0272-43b4-8f4d-99da6f035168 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.080424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0900cd-0272-43b4-8f4d-99da6f035168 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.100057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 234/476] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:43 2022] POST /identity/v3/users => generated 248 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:44.100057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395e4c1-6847-4e6b-8fe0-bd1ca3348cd0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.123600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 243/477] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:43 2022] POST /identity/v3/users => generated 249 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:44.225339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395e4c1-6847-4e6b-8fe0-bd1ca3348cd0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.265959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.266713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.266938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.267209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.267969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.269522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.280385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.sql.core [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 11:46:44.280385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 10 11:46:44.280385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [parameters: {'id': '1ca0385ac9b3476a8e8551173cbd79f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 10 11:46:44.280385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81409) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result.read() Oct 10 11:46:44.299251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return ref.to_dict() Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:46:44.300205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application yield resource Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise self.value Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application session.commit() Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 11:46:44.301148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.session.flush() Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application compat.raise_( Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 11:46:44.302633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:46:44.303572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result.read() Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:46:44.304406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [parameters: {'id': '1ca0385ac9b3476a8e8551173cbd79f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:44.306563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 10 11:46:44.308540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:44.310555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 235/478] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 10 11:46:44 2022] POST /identity/v3/roles => generated 144 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:44.319108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0900cd-0272-43b4-8f4d-99da6f035168 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.447456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0900cd-0272-43b4-8f4d-99da6f035168 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.482935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8b8ea-e7e1-47c2-aa6b-bd45ec9dcf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.483915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8b8ea-e7e1-47c2-aa6b-bd45ec9dcf56 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.484415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8b8ea-e7e1-47c2-aa6b-bd45ec9dcf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.484898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8b8ea-e7e1-47c2-aa6b-bd45ec9dcf56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.495478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8b8ea-e7e1-47c2-aa6b-bd45ec9dcf56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0ec8b8ea-e7e1-47c2-aa6b-bd45ec9dcf56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:44.500996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:44.501968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 10 11:46:44.502796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:44.503957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 244/479] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:46:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:44.510136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:44.543137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:44.633796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e963ad-1f3b-43a5-a624-574dbe8d5806 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:44.676342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d14cf-287b-4d14-b458-442c2caffd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:44.677016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d14cf-287b-4d14-b458-442c2caffd89 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:44.677407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d14cf-287b-4d14-b458-442c2caffd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:44.677680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d14cf-287b-4d14-b458-442c2caffd89 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:44.678340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d14cf-287b-4d14-b458-442c2caffd89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:44.678641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d14cf-287b-4d14-b458-442c2caffd89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:44.680011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d14cf-287b-4d14-b458-442c2caffd89 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:44.690823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 236/480] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:45.504082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461f2ca-f2ef-486d-af7c-5eba42d0c6bb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.505676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461f2ca-f2ef-486d-af7c-5eba42d0c6bb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.506203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461f2ca-f2ef-486d-af7c-5eba42d0c6bb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.507946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 245/481] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:45.513558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1291f0-eeb3-4bc2-80a8-cbbab8f7ee2f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.514382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1291f0-eeb3-4bc2-80a8-cbbab8f7ee2f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.514855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1291f0-eeb3-4bc2-80a8-cbbab8f7ee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.537332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-aa1291f0-eeb3-4bc2-80a8-cbbab8f7ee2f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:45.538524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aa1291f0-eeb3-4bc2-80a8-cbbab8f7ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:45.627570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 237/482] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:45.932599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa9e8-8524-4ebb-9db0-95b46845a10a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.932958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa9e8-8524-4ebb-9db0-95b46845a10a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.933200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa9e8-8524-4ebb-9db0-95b46845a10a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.934761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 246/483] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:45.940101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2c47-7938-4aaa-a283-c907d7741561 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:45.940397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2c47-7938-4aaa-a283-c907d7741561 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:45.940673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2c47-7938-4aaa-a283-c907d7741561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:45.969981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-78df2c47-7938-4aaa-a283-c907d7741561 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:45.971190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-78df2c47-7938-4aaa-a283-c907d7741561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:45.980143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:46.063412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 238/484] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:46.084752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa9e8-8524-4ebb-9db0-95b46845a10a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:46.161900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:46.237712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa9e8-8524-4ebb-9db0-95b46845a10a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:46.272375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2a61-bab6-4228-93ea-f869c33fac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:46.273104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2a61-bab6-4228-93ea-f869c33fac3d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:46.273378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2a61-bab6-4228-93ea-f869c33fac3d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:46.273647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2a61-bab6-4228-93ea-f869c33fac3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:46.284123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae2a61-bab6-4228-93ea-f869c33fac3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-dbae2a61-bab6-4228-93ea-f869c33fac3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:46.289749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:46.290658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:46.291487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 247/485] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:46.296824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df2c47-7938-4aaa-a283-c907d7741561 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:46.417967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df2c47-7938-4aaa-a283-c907d7741561 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:46.460446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:46.461095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:46.461377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:46.461646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:46.462310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:46.462608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:46.463969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:46.474406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 239/486] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:46.479556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2a61-bab6-4228-93ea-f869c33fac3d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:46.494160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:46.498348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:46.594675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edde1f0-8989-406d-b350-56931e3ff84d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:46.630446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ec8cb-118d-411b-853c-ecb33414c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:46.631081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec8cb-118d-411b-853c-ecb33414c80c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:46.631356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec8cb-118d-411b-853c-ecb33414c80c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:46.631624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec8cb-118d-411b-853c-ecb33414c80c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:46.650372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ec8cb-118d-411b-853c-ecb33414c80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-dd2ec8cb-118d-411b-853c-ecb33414c80c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:46.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:46.656592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:46.657436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:46.658520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 240/487] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:46.667368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ec8cb-118d-411b-853c-ecb33414c80c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:46.717424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:46.734863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2a61-bab6-4228-93ea-f869c33fac3d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:46.736725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:46.772669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ec8cb-118d-411b-853c-ecb33414c80c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:46.810458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:46.810458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:46.810458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:46.810458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:46.810859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:46.810957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:46.814548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:46.822403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 241/488] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:46.827898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:46.844667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:46.845344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:46.845620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:46.845893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:46.861517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:46.865838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:46.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:46.891092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:46.892049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:46.892049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:46.892049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:46.894149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 248/489] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:46.902693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.001775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb2dce-822a-4b75-beb1-d02ebbc48915 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.015359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6dc57-0c5b-4a79-90cc-24d76568f593 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.028953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.038718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182aeb7-2620-4056-b7b3-52918969f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.039871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182aeb7-2620-4056-b7b3-52918969f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.040281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182aeb7-2620-4056-b7b3-52918969f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.040552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182aeb7-2620-4056-b7b3-52918969f3c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.049408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e36b2-ee4c-4a52-8bff-ba4a4337d5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.050013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e36b2-ee4c-4a52-8bff-ba4a4337d5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.050298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e36b2-ee4c-4a52-8bff-ba4a4337d5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.050566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e36b2-ee4c-4a52-8bff-ba4a4337d5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.051217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e36b2-ee4c-4a52-8bff-ba4a4337d5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:47.051520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e36b2-ee4c-4a52-8bff-ba4a4337d5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:47.053335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182aeb7-2620-4056-b7b3-52918969f3c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:47.053462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e36b2-ee4c-4a52-8bff-ba4a4337d5b5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:47.055177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182aeb7-2620-4056-b7b3-52918969f3c9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:47.065411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 249/490] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:47.066609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e89b3-be9c-4dc7-b241-230cd119b5b6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.066889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e89b3-be9c-4dc7-b241-230cd119b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.067159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e89b3-be9c-4dc7-b241-230cd119b5b6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.068902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 250/491] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:47.069917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9bf5-ec54-4715-aa65-fc571194e22c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.070191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9bf5-ec54-4715-aa65-fc571194e22c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.070463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9bf5-ec54-4715-aa65-fc571194e22c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.071864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 251/492] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c182aeb7-2620-4056-b7b3-52918969f3c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:47.072149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:47.073072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:47.073937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:47.073937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:47.073937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:47.073937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 242/493] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:47.078355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786087bc-1a76-413b-9956-01efb37b1fee None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.078565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90993432-4b1b-41f6-a6c1-e0d2929da74c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.078663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786087bc-1a76-413b-9956-01efb37b1fee None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.078830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90993432-4b1b-41f6-a6c1-e0d2929da74c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.078920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786087bc-1a76-413b-9956-01efb37b1fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.079061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90993432-4b1b-41f6-a6c1-e0d2929da74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.096919 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-786087bc-1a76-413b-9956-01efb37b1fee None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:47.098138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-786087bc-1a76-413b-9956-01efb37b1fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:47.098651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-90993432-4b1b-41f6-a6c1-e0d2929da74c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:47.100343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90993432-4b1b-41f6-a6c1-e0d2929da74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:47.100685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.181003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 252/494] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:47.181003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786087bc-1a76-413b-9956-01efb37b1fee None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.183925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 243/495] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:47.184902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90993432-4b1b-41f6-a6c1-e0d2929da74c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.357797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786087bc-1a76-413b-9956-01efb37b1fee None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.376110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90993432-4b1b-41f6-a6c1-e0d2929da74c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.394846 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.399615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.400430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.400844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.401274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.408990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:47.410598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:47.412945 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:47.425946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:47.427538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:46:47.428661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:47.430771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 253/496] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:47.437955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.448053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.448693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.448997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.449284 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.449949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:47.450261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:47.451700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:47.465739 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 244/497] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:47.471090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.561217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192f304-4608-4097-a0e3-167745704a8f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.582154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84997cd-bace-449e-8c4a-bc246c9fbfd1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.595344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.595943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.596218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.596485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.597227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:47.597528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:47.599552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:47.615698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83fc37-7f89-44c2-b043-4241731b6b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.616259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83fc37-7f89-44c2-b043-4241731b6b2d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.616538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83fc37-7f89-44c2-b043-4241731b6b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.616805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83fc37-7f89-44c2-b043-4241731b6b2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.626703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83fc37-7f89-44c2-b043-4241731b6b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-2b83fc37-7f89-44c2-b043-4241731b6b2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:47.632213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:47.633330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 245/498] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:47.634184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83fc37-7f89-44c2-b043-4241731b6b2d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.638145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 254/499] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:47.639138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.663607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.695225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.734905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83fc37-7f89-44c2-b043-4241731b6b2d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.738477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c938b2-4f01-489c-8918-4d63e8473cce None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.767097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.767790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.768071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.768335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.771545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f01114-37f8-4055-bb9e-937e665f7ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.772165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01114-37f8-4055-bb9e-937e665f7ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.772441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01114-37f8-4055-bb9e-937e665f7ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.772704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f01114-37f8-4055-bb9e-937e665f7ac4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.776216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:47.777697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:47.782735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f01114-37f8-4055-bb9e-937e665f7ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e1f01114-37f8-4055-bb9e-937e665f7ac4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:47.787996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:47.789092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:47.789911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 255/500] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:47.790597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c634a6-214b-444c-84a6-755662cbe503 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.790597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c634a6-214b-444c-84a6-755662cbe503 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:47.790712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:47.791671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:46:47.792585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:47.793134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c634a6-214b-444c-84a6-755662cbe503 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.793327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 246/501] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:47.794309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.796501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 256/502] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:47.797226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c634a6-214b-444c-84a6-755662cbe503 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:47.882860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.895178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1f4ca-b978-443a-9a1c-e769994ce002 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.899297 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c634a6-214b-444c-84a6-755662cbe503 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:47.917109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:47.929369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.929983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.930264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.930538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.931190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:47.931494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:47.932872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:47.935346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c896e-6e9f-4aac-a350-8b50998e17d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:47.935937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c896e-6e9f-4aac-a350-8b50998e17d2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:47.936212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c896e-6e9f-4aac-a350-8b50998e17d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:47.936480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c896e-6e9f-4aac-a350-8b50998e17d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:47.940657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 247/503] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:47.941471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.004315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c896e-6e9f-4aac-a350-8b50998e17d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.006305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c896e-6e9f-4aac-a350-8b50998e17d2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.038048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24102397-d4f9-4b14-99a8-71cd25d6fab2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.070791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.071399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.071679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.071951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.072596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:48.072900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.074279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.082063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 248/504] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:48.082858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.096893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.106917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 257/505] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:48.108149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841520-0f38-4a26-8a18-61a1a02b6188 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.108435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841520-0f38-4a26-8a18-61a1a02b6188 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.108708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841520-0f38-4a26-8a18-61a1a02b6188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.126404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c1841520-0f38-4a26-8a18-61a1a02b6188 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:48.127642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c1841520-0f38-4a26-8a18-61a1a02b6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:48.139100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.187161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa267ea7-a1a8-404c-96a3-ea5a59abdcb2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.194322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 258/506] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:48.195132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1841520-0f38-4a26-8a18-61a1a02b6188 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.222026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.222657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.222935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.223207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.224476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:48.225221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.226633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.267580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 249/507] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:48.267580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.308922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1841520-0f38-4a26-8a18-61a1a02b6188 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.341122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.343683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.344309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.344634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.344856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.355551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.357017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.363711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:48.372384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:48.373344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:48.374212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:48.374212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:48.374212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:48.374212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 259/508] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:48.374212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.382713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7da03-49b5-4244-996d-4fc8eec27798 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.417789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.418355 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.418643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.418916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.428778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.430269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:48.445868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:48.446779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:48.447660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:48.447660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:48.447660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:48.447660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 250/509] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:48.448425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.484081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd4c5a-82ff-429e-86c7-f3e8a50de613 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.516142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.516765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.517087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.517361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.528122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.529626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:48.544035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:48.544953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:48.545836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:48.545836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:48.545836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:48.545836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 260/510] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:48.546051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.552615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10405-da44-4848-8e1d-b3c1f492cf17 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.574965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.588197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3361-fa24-46c2-aca1-27f219de0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.588801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3361-fa24-46c2-aca1-27f219de0cef None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.589108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3361-fa24-46c2-aca1-27f219de0cef None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.589380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3361-fa24-46c2-aca1-27f219de0cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.594638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.644391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907ac71-6796-4e05-a86e-5c8658add71c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.656348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b3361-fa24-46c2-aca1-27f219de0cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.657829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b3361-fa24-46c2-aca1-27f219de0cef None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.676884 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.677522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.677825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.678079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.678714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:48.679014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.680385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.691744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 261/511] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:48.693070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.760749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 251/512] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:48.761621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3361-fa24-46c2-aca1-27f219de0cef None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.785369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.789878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131048f8-6821-4f3e-a1c3-76e72fe04b71 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.800246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:48.824757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.825387 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.825662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.825927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.826555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:48.826848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.828224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.839505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 262/513] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:48.840294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.865378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3361-fa24-46c2-aca1-27f219de0cef None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.899445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.900073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.900353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.900622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.911390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.913166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:48.929162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:48.930275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:48.931349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:48.931349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:48.931349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:48.935224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 252/514] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:48.935928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:48.938246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099d65-0de2-44ff-9e84-0bf05975bbec None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:48.971255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:48.971851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:48.972131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:48.972402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:48.973062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:48.973366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:48.974768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:48.986323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 263/515] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:48.987109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.010408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.017140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.035277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f68ae-b294-40fc-b7ee-4275f4399546 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.068910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.069564 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.069843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.070139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.077904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.079342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.088088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c6e52-071b-4ad5-89c0-d42a90c441e0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:49.090096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:49.091191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 253/516] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:49.092094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.124066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.124768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.125079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.125346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.136459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.137962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:49.152170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:49.153304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:49.154371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:49.154371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:49.154371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:49.154371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 264/517] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:49.154371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.193190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709a379-a0df-48e4-ba0c-11f53a78fc1d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.224989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.225615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.225911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.226181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.228005 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.232554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.235025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.236530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:49.248118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:49.249240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 254/518] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:49.250377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.254137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe8a48-633c-46c7-8071-0b334a7886fc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.286698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.287293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.287568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.287833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.288457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:49.288752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.290147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.301385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 265/519] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:49.302643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.350851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9f59-6892-4837-8dac-65281abae1ca None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.386955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.387582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.387858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.388125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.394822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.396264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.399325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53152276-29b7-47e5-a9d9-f18403c87a8b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:49.407774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:49.408634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:49.409529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 255/520] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:49.410003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.438958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.439558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.439830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.440338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.440808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:49.441130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.442575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.456528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.460818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 266/521] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:49.462134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.464383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.509214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37dfab-7f74-4749-8bbd-1e4d568c229e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.542099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.542702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.542984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.543249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.543881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:49.544190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.545575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.557479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 256/522] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:49.558239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.564882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e3caf-7409-45c2-8f33-1a4cb99748b5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.599502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.600098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.600372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.600639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.601400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:49.601700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.603106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.619290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 267/523] 10.222.0.45 () {56 vars in 1139 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:49.620062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.657401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af186-4e3a-47f1-a924-ff3515ad5ee6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.670725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.677732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.691520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32271-e3c8-4b70-8b63-b185bf4aa767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.692118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32271-e3c8-4b70-8b63-b185bf4aa767 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.692441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32271-e3c8-4b70-8b63-b185bf4aa767 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.693240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32271-e3c8-4b70-8b63-b185bf4aa767 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.693874 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c32271-e3c8-4b70-8b63-b185bf4aa767 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.695300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c32271-e3c8-4b70-8b63-b185bf4aa767 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.714769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 257/524] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:46:49 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:46:49.715487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32271-e3c8-4b70-8b63-b185bf4aa767 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.727174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59edae-2fe6-4628-aa88-f7a746fe76b9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.767307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.768283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.768749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.769054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.769775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:49.770122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.771677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.790734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 268/525] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:49.791615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:49.838149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32271-e3c8-4b70-8b63-b185bf4aa767 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.877285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9af4-07a0-4085-8c21-82d79af9f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.877899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9af4-07a0-4085-8c21-82d79af9f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.878176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9af4-07a0-4085-8c21-82d79af9f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.878444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9af4-07a0-4085-8c21-82d79af9f3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.910784 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4fc7c-6145-4202-8552-25a1c8350b91 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:49.928637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.933605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:49.951379 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:49.952014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:49.952347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:49.952626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:49.960001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.961513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.965670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9af4-07a0-4085-8c21-82d79af9f3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:49.967047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9af4-07a0-4085-8c21-82d79af9f3a2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:49.978609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:49.979697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:49.980666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 269/526] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:49.981194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.078486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 258/527] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:50.079156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9af4-07a0-4085-8c21-82d79af9f3a2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.096993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632566-ab40-4511-8143-27062ddba1e2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.133336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343873d-5e58-4900-9ca7-2c4e3a7fc823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.134040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343873d-5e58-4900-9ca7-2c4e3a7fc823 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.134390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343873d-5e58-4900-9ca7-2c4e3a7fc823 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.134736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343873d-5e58-4900-9ca7-2c4e3a7fc823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.151794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.182828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.187859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9af4-07a0-4085-8c21-82d79af9f3a2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.209592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343873d-5e58-4900-9ca7-2c4e3a7fc823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.211055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343873d-5e58-4900-9ca7-2c4e3a7fc823 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.225645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.226184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.226463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.226737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.227459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=aa51dcbe21f04f24887beb458edb1dce) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:50.227761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.229196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.234846 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 259/528] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/role_assignments?user.id=aa51dcbe21f04f24887beb458edb1dce&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:50.235620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.341204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 270/529] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:50.342371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343873d-5e58-4900-9ca7-2c4e3a7fc823 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.364164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215c8b-8a2a-4bb6-b336-d26843ab98ed None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.410213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.410867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.411182 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.411452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.412150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:50.412451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.413923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.416018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.438265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 260/530] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:50.444424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.450618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.480623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343873d-5e58-4900-9ca7-2c4e3a7fc823 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.525500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.526681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.527137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.527821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.546421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.548169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.561995 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a444cc-7293-46c9-b460-9328fcf9a8d4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:50.569203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:50.570124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:50.571006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:50.571006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:50.571006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:50.571006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 271/531] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:50.571968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.606514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.607474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.607979 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.608425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.620593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.622749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:50.643602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:50.644589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:50.645535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:50.645535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:50.645535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:50.647494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 261/532] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:50.648459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.688579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da2850-b1d2-406d-bda0-4a7b08a2a11c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.699252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.720487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:50.726909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.727685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.728039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.728386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.729427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=4becd85ee7bb4920996dfe7b919aaa71) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:50.729680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.731238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.737273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 272/533] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/role_assignments?user.id=4becd85ee7bb4920996dfe7b919aaa71&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:50.738150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.764408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b7245-351e-4890-aad5-000399afbd99 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.804486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.805616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.806184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.806639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.807575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:50.808059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.810356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.837309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 262/534] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:50.843407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:50.855338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad52-c837-43c6-898e-3c53551c10b7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:50.895431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:50.895872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:50.896154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:50.897781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:50.898160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:50.898468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:50.899889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:50.932555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 273/535] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:50.938053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:51.037338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:51.044701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2273ec-8695-4531-9817-1702107d19cb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:51.070414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:51.103505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:51.103505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.103505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.103505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.109277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.111037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:51.123430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:51.124341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:51.125657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 263/536] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:51.131402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:51.132921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4efc-5aca-4635-82bb-8d8f0ea6f426 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:51.234291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:51.235370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.235888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.236371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c315f-a356-41d3-a2fe-070048bd6335 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:51.236480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.254415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.256338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.273998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:51.274607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.274887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.275160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.275843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:51.276148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.277627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:51.280512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:51.281370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:51.282219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:51.282219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:51.282219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:51.282219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:51.282219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:51.282219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:51.282219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:51.282219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:51.290569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 264/537] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:51.291267 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 274/538] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:51.296466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:51.297281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:51.325385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:51.404851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66d185-68fc-410c-9cdd-67e7a0e694fc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:51.470028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:51.470640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.470917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.471188 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.471908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=bcb79c07e68446d19ac3aeb2279fd887) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:51.472214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.474229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.495376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 265/539] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:51 2022] GET /identity/v3/role_assignments?user.id=bcb79c07e68446d19ac3aeb2279fd887&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:51.505417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9670fc-3a26-43d0-940c-ba5d804fb180 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:51.522110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:51.550282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193d87-bedb-4ef9-b7a4-5853f0d77581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:51.550810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193d87-bedb-4ef9-b7a4-5853f0d77581 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.551090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193d87-bedb-4ef9-b7a4-5853f0d77581 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.551360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193d87-bedb-4ef9-b7a4-5853f0d77581 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.552092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193d87-bedb-4ef9-b7a4-5853f0d77581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:51.552396 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193d87-bedb-4ef9-b7a4-5853f0d77581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.553856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193d87-bedb-4ef9-b7a4-5853f0d77581 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.571405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 275/540] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:51.577258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:51.681965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:51.692958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e445746-38de-4c1e-bd96-0ab14d596719 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:51.729349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37d081-f747-4d69-a220-7c306b5b5a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:51.729964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d081-f747-4d69-a220-7c306b5b5a16 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:51.730222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d081-f747-4d69-a220-7c306b5b5a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:51.730491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d081-f747-4d69-a220-7c306b5b5a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:51.731214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37d081-f747-4d69-a220-7c306b5b5a16 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=3a1f548368994994a2966b7818e8b0e9) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:51.731521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37d081-f747-4d69-a220-7c306b5b5a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:51.732955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37d081-f747-4d69-a220-7c306b5b5a16 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:51.739186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 266/541] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:51 2022] GET /identity/v3/role_assignments?user.id=3a1f548368994994a2966b7818e8b0e9&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:52.073620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cc04b-3baa-4ba8-9517-5e61015f3eab None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.074117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cc04b-3baa-4ba8-9517-5e61015f3eab None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.074117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cc04b-3baa-4ba8-9517-5e61015f3eab None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.075721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 276/542] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:52.081001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee154e8-ac36-46c6-a591-bae6010d4e28 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.081311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee154e8-ac36-46c6-a591-bae6010d4e28 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.081585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee154e8-ac36-46c6-a591-bae6010d4e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.105978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1ee154e8-ac36-46c6-a591-bae6010d4e28 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:52.107240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1ee154e8-ac36-46c6-a591-bae6010d4e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:52.199494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 267/543] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:52.504072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cc04b-3baa-4ba8-9517-5e61015f3eab None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:52.632246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cc04b-3baa-4ba8-9517-5e61015f3eab None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:52.678341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315da9-2c06-4c04-b707-1127a3bafd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:52.678966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315da9-2c06-4c04-b707-1127a3bafd36 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.679239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315da9-2c06-4c04-b707-1127a3bafd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.679505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315da9-2c06-4c04-b707-1127a3bafd36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.692301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51315da9-2c06-4c04-b707-1127a3bafd36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-51315da9-2c06-4c04-b707-1127a3bafd36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:52.697467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:52.698348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:52.699160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:52.702362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 277/544] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:52.704390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee154e8-ac36-46c6-a591-bae6010d4e28 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:52.824993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:52.838772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee154e8-ac36-46c6-a591-bae6010d4e28 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:52.881155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaaf91-4ba4-4176-802f-8b974dc8237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:52.881782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaaf91-4ba4-4176-802f-8b974dc8237e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:52.882060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaaf91-4ba4-4176-802f-8b974dc8237e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:52.882329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaaf91-4ba4-4176-802f-8b974dc8237e None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:52.883006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaaf91-4ba4-4176-802f-8b974dc8237e None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:52.883300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaaf91-4ba4-4176-802f-8b974dc8237e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:52.884673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaaf91-4ba4-4176-802f-8b974dc8237e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:52.897071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 268/545] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:52.900019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315da9-2c06-4c04-b707-1127a3bafd36 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:52.957153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.021381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4d79-1725-4b97-8dad-ade527cb1502 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.021710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4d79-1725-4b97-8dad-ade527cb1502 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.021942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b4d79-1725-4b97-8dad-ade527cb1502 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.023614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 269/546] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:53.029772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17bf5-fcb8-4da0-baa4-e1c44dccca6c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.030053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17bf5-fcb8-4da0-baa4-e1c44dccca6c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.030327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17bf5-fcb8-4da0-baa4-e1c44dccca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.058646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315da9-2c06-4c04-b707-1127a3bafd36 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.064807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f8b17bf5-fcb8-4da0-baa4-e1c44dccca6c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:53.066016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f8b17bf5-fcb8-4da0-baa4-e1c44dccca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:53.113210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.113872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.114058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.114326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.135531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.137002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:53.168368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:53.169386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:53.170238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:53.170238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:53.170238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:53.174039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 278/547] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:53.174852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.190229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 270/548] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:46:53.268115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.284576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7eb1c0-0e96-401a-a063-b2ddf55fee74 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.318931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02323780-362f-4a02-9997-d916355b9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.319757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02323780-362f-4a02-9997-d916355b9588 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.320183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02323780-362f-4a02-9997-d916355b9588 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.320601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02323780-362f-4a02-9997-d916355b9588 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.321431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02323780-362f-4a02-9997-d916355b9588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:53.321898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02323780-362f-4a02-9997-d916355b9588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.323409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02323780-362f-4a02-9997-d916355b9588 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.339875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 279/549] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:53.345481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17bf5-fcb8-4da0-baa4-e1c44dccca6c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.459783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.492816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17bf5-fcb8-4da0-baa4-e1c44dccca6c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.545009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02323780-362f-4a02-9997-d916355b9588 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.550772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cb421-2658-45a5-9856-0809622f530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.551979 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cb421-2658-45a5-9856-0809622f530c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.552263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cb421-2658-45a5-9856-0809622f530c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.552533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cb421-2658-45a5-9856-0809622f530c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.564353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cb421-2658-45a5-9856-0809622f530c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.565853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cb421-2658-45a5-9856-0809622f530c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-061cb421-2658-45a5-9856-0809622f530c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:53.582117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:53.583727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:53.584752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 271/550] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:53.596890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cb421-2658-45a5-9856-0809622f530c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.675596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02323780-362f-4a02-9997-d916355b9588 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.722010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9710ad-8f2e-4787-baa4-c474934b833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.722564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9710ad-8f2e-4787-baa4-c474934b833d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.723189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9710ad-8f2e-4787-baa4-c474934b833d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.723611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9710ad-8f2e-4787-baa4-c474934b833d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.737812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9710ad-8f2e-4787-baa4-c474934b833d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:53.739455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cb421-2658-45a5-9856-0809622f530c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8c9710ad-8f2e-4787-baa4-c474934b833d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:53.744675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:53.745810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:53.747033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:53.749718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 280/551] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:46:53.751808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef8f8-d5c8-4a47-871d-6f0134c9721b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.752262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef8f8-d5c8-4a47-871d-6f0134c9721b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.752964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ef8f8-d5c8-4a47-871d-6f0134c9721b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.755268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 281/552] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:53.756131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ef8f8-d5c8-4a47-871d-6f0134c9721b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.765783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.782319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d0515-9104-4585-b14e-8045ff4e5a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.782960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d0515-9104-4585-b14e-8045ff4e5a6b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.783319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d0515-9104-4585-b14e-8045ff4e5a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.783678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d0515-9104-4585-b14e-8045ff4e5a6b None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.784463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d0515-9104-4585-b14e-8045ff4e5a6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:53.784834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d0515-9104-4585-b14e-8045ff4e5a6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.786451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d0515-9104-4585-b14e-8045ff4e5a6b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.789304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:53.812454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 272/553] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:53.812454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f75a-6377-447b-a75d-01c5e4692e59 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.812454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f75a-6377-447b-a75d-01c5e4692e59 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.812454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45f75a-6377-447b-a75d-01c5e4692e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.840301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2b45f75a-6377-447b-a75d-01c5e4692e59 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:53.841894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2b45f75a-6377-447b-a75d-01c5e4692e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:53.877241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ef8f8-d5c8-4a47-871d-6f0134c9721b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:53.914664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:53.915667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:53.916124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:53.916601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:53.917505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:53.918062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:53.919835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:53.929094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 273/554] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:53.930113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45f75a-6377-447b-a75d-01c5e4692e59 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:53.930515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 282/555] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:53.936764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.058109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45f75a-6377-447b-a75d-01c5e4692e59 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.078910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.086788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.099415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff23e2-6e6e-4b03-87e5-01c1bbad37f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.100037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff23e2-6e6e-4b03-87e5-01c1bbad37f5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.100324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff23e2-6e6e-4b03-87e5-01c1bbad37f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.100600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff23e2-6e6e-4b03-87e5-01c1bbad37f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.149891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cade5-7baa-4380-8624-c4a8496cffac None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.190915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f51a2-cfba-4deb-9363-318d0435a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.191626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f51a2-cfba-4deb-9363-318d0435a98e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.192056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f51a2-cfba-4deb-9363-318d0435a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.192440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f51a2-cfba-4deb-9363-318d0435a98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.197600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff23e2-6e6e-4b03-87e5-01c1bbad37f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.199260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff23e2-6e6e-4b03-87e5-01c1bbad37f5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.206669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f51a2-cfba-4deb-9363-318d0435a98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.208790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f51a2-cfba-4deb-9363-318d0435a98e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f70f51a2-cfba-4deb-9363-318d0435a98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:54.225631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:54.226582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:54.227490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:54.227490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:54.227490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:54.233405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 283/556] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:54.234837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71a7a4-0437-48ec-9b55-da50061f1882 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.235125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71a7a4-0437-48ec-9b55-da50061f1882 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.235402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71a7a4-0437-48ec-9b55-da50061f1882 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.236995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 284/557] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:54.242073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71a7a4-0437-48ec-9b55-da50061f1882 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.317083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 274/558] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:46:54.319527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a155770-f6e2-4c4f-8181-fa537df6aba4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.319527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a155770-f6e2-4c4f-8181-fa537df6aba4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.319527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a155770-f6e2-4c4f-8181-fa537df6aba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.340326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9a155770-f6e2-4c4f-8181-fa537df6aba4 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:54.341587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9a155770-f6e2-4c4f-8181-fa537df6aba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:54.360593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.362897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71a7a4-0437-48ec-9b55-da50061f1882 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.387831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.407393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.408000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.408271 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.408548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.409240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:54.409534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.411639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.416578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 275/559] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:54.417620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a155770-f6e2-4c4f-8181-fa537df6aba4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.430829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 285/560] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:54.431971 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.527374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a155770-f6e2-4c4f-8181-fa537df6aba4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.546743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2638f9-8568-4431-9c1f-6f0f24f7c36f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.566526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f1801-8f7d-4143-a728-128a2c70cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.567741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1801-8f7d-4143-a728-128a2c70cab5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.567957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1801-8f7d-4143-a728-128a2c70cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.568282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1801-8f7d-4143-a728-128a2c70cab5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.585627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f1801-8f7d-4143-a728-128a2c70cab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:54.587147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.587787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.588057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.588325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-762f1801-8f7d-4143-a728-128a2c70cab5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:54.590616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:54.591537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:54.592575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 276/561] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:54.593319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a3d8-e1b7-40ce-a5b9-8f353b3dfd3b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.593972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a3d8-e1b7-40ce-a5b9-8f353b3dfd3b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.593972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a3d8-e1b7-40ce-a5b9-8f353b3dfd3b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.595160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 277/562] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:54.599960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a3d8-e1b7-40ce-a5b9-8f353b3dfd3b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.604437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.605946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:54.620620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:54.621648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:54.622561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:54.622561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:54.622561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:54.622756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.622831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 286/563] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:54.622831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.655159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.720147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a3d8-e1b7-40ce-a5b9-8f353b3dfd3b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.725814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0bcc5-3cdc-49e9-ad48-00730a244240 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.753553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.754699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.754978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.755252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.758280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efc24f-4c5b-424a-84c1-b5f43f2cafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.758869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc24f-4c5b-424a-84c1-b5f43f2cafbf None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.759144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc24f-4c5b-424a-84c1-b5f43f2cafbf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.759411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efc24f-4c5b-424a-84c1-b5f43f2cafbf None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.760057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc24f-4c5b-424a-84c1-b5f43f2cafbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:54.760354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc24f-4c5b-424a-84c1-b5f43f2cafbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.761746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efc24f-4c5b-424a-84c1-b5f43f2cafbf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.762010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.763432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.769525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 287/564] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:54.771201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc02a4-e87f-4184-b597-bcd22f153701 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.771487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc02a4-e87f-4184-b597-bcd22f153701 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.771758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc02a4-e87f-4184-b597-bcd22f153701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:54.775590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:54.781160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 278/565] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:54.782218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.794793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c4cc02a4-e87f-4184-b597-bcd22f153701 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:54.795989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c4cc02a4-e87f-4184-b597-bcd22f153701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:54.854506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.863083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 288/566] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:54.863978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc02a4-e87f-4184-b597-bcd22f153701 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.888144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9e9d-1b45-49bf-a9e5-505118ec1cdc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:54.889585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:54.924574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:54.925535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:54.925818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:54.926599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:54.927356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:54.927659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:54.929148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:54.942267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 279/567] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:54.943071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:54.971210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc02a4-e87f-4184-b597-bcd22f153701 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.004058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afee10-bb7c-41f3-b267-0a17e27dfde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.004851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afee10-bb7c-41f3-b267-0a17e27dfde0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.005194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afee10-bb7c-41f3-b267-0a17e27dfde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.005468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afee10-bb7c-41f3-b267-0a17e27dfde0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.017755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afee10-bb7c-41f3-b267-0a17e27dfde0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-69afee10-bb7c-41f3-b267-0a17e27dfde0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:55.024689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:55.025829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 289/568] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:55.030013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afee10-bb7c-41f3-b267-0a17e27dfde0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.052250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb0435-aa36-4e73-98ac-9a4b9939ab64 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.087351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.088096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.088378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.088656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.090648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.101308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.102763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:55.117683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:55.118653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:55.119584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:55.119584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:55.119584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:55.119758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.119831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 280/569] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:55.119831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.139454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afee10-bb7c-41f3-b267-0a17e27dfde0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.174037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.174627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.174905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.175175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.175895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:55.176226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.177695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.194244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 290/570] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:55.195029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.224761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cee16-5695-48f5-bdaa-01313d2446fb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.256955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.257604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.257876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.258141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.264528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.265975 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:55.277576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:55.278663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:55.279608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 281/571] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:55.280146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.294914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d6e4e-7688-436a-9a47-6f8447dbdb96 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.324474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.328028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.328634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.328914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.329217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.329874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:55.330180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.331554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.340032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 291/572] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:55.340959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.344580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.379818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a39b4-4ebd-456b-a93b-2ba9287ef6a8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.412544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.413170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.413456 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.413727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.414352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:55.414650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.415997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.428286 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 282/573] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:55.429083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.450513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbee62-2eba-4917-a722-5033de595c95 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.483728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce645-bf68-4b73-b25c-1a19f66ab5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.484350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce645-bf68-4b73-b25c-1a19f66ab5da None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.484628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce645-bf68-4b73-b25c-1a19f66ab5da None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.484903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ce645-bf68-4b73-b25c-1a19f66ab5da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.495431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ce645-bf68-4b73-b25c-1a19f66ab5da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e55ce645-bf68-4b73-b25c-1a19f66ab5da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:55.500563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:55.501520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:55.502369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 292/574] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:55.503503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce645-bf68-4b73-b25c-1a19f66ab5da None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.526899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606da6d-a8d4-4ef3-9a64-35b10fdf5932 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.534080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.561719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.562201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.562327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.562760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.562891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.572676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.574136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:55.588225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:55.589453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:55.590338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:55.590338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:55.590338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:55.590338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 283/575] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:55.590574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.606038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ce645-bf68-4b73-b25c-1a19f66ab5da None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.640325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.640856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.641178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.641454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.642140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:55.642445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.643870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.656005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 293/576] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:55.656774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.695656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ff61-dd93-47a8-be9e-6deb38eb9f1f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.727522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.728142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.728421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.728692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.739440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.740872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.751226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d3dd4-d66f-42e7-99fd-e69b532ded75 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:55.755360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:55.756299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:55.757233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:55.757233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:55.757233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:55.757233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 284/577] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:55.757233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.769795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.775756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:55.786784 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.787431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.787706 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.787986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.794840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.796266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:55.809042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:55.810013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 294/578] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:55.811002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.861691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f095dc7-6336-4c4f-bde1-d00f1bbcdfb9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.893826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.894363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.895153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.895428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.896079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:55.896378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.897807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.905684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 285/579] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:55.906455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.912816 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b897e-5787-4e8e-a3e9-2d04d5bbbb04 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:55.945205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:55.945796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:55.946073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:55.946347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:55.946978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:55.947276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:55.948654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:55.960581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 295/580] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:55.961294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:55.975940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.005595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f4ca-b1ef-4793-91cb-d8a86d618f24 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.007049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.039667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.040279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.040555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.040832 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.041575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:56.041899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.043300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.048692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 286/581] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/role_assignments?user.id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:56.049615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.061362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c17db-568d-456c-8139-fc68cbc3a211 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.105419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.106051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.106331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.106603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.107266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:56.107570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.109922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.130957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 296/582] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:56.130957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.159477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18217ae8-0ebc-446d-a215-b4f843c6b988 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.197001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.197652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.197932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.198204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.198942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:56.199246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.200719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.203638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.220545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 287/583] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:56.221713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.249725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fcd22-8aba-402c-b0f3-0f2e32dabf6f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.252004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.285808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.286462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.286718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.286991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.297788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.299240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:56.313440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:56.314415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:56.315296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:56.315296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:56.315296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:56.315296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 297/584] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:56.315296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.343948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085b328-462e-4dcd-81cf-d55b29cb5297 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.378368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.379558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.379850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.380087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.386931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.388365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:56.400653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:56.401736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 288/585] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:56.402672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.426856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1e738-2acc-41b6-91e5-96354ec43465 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.461601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ac000-b962-4509-937b-37d03928716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.461827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.462230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ac000-b962-4509-937b-37d03928716d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.462508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ac000-b962-4509-937b-37d03928716d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.462832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ac000-b962-4509-937b-37d03928716d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.470710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ac000-b962-4509-937b-37d03928716d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.472172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ac000-b962-4509-937b-37d03928716d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-443ac000-b962-4509-937b-37d03928716d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:56.483265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:56.484416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:46:56.485806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:56.489783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 298/586] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:56.490691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ac000-b962-4509-937b-37d03928716d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.510943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.515406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeed92-8dd0-4e0c-bde0-3fb8d01b0d80 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.549850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.550481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.550763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.551573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.563246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.564696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:56.579866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:56.581055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:56.582321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:56.582321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:56.582321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:56.582321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 289/587] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:56.582321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.602757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ac000-b962-4509-937b-37d03928716d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.637492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40466-6037-4450-b472-b26c25774219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.638098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40466-6037-4450-b472-b26c25774219 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.638437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40466-6037-4450-b472-b26c25774219 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.638710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d40466-6037-4450-b472-b26c25774219 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.639374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d40466-6037-4450-b472-b26c25774219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:56.639676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d40466-6037-4450-b472-b26c25774219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.641062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d40466-6037-4450-b472-b26c25774219 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.653567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 299/588] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:56.654357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40466-6037-4450-b472-b26c25774219 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.688535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246652d6-cb75-445c-bf8d-6df3d267939c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.695966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.725616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.726220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.726499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.726769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.727453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:56.727759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.729199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.731424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.741495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 290/589] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:56.746769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.758698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d40466-6037-4450-b472-b26c25774219 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.794462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.795070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.795345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.795647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.796324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:56.796797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.798120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.819050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 300/590] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:56.819818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.861942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5fe4b-cfec-4729-bc57-ceaa69b39870 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.897169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.897776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.898057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.898334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.898977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:56.899282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.900642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.918106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 291/591] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:56.918106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:56.929765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b768f30-64a9-41f0-aa24-fbdb827a0f3c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:56.946754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.970143 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:56.970989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:56.971267 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:56.971539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:56.974055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:56.980224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:56.982170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:56.994243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:56.995192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:46:56.996121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:57.000006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 301/592] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:57.000833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.025136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12619a-c187-4fb5-bbaf-474c4b6eabbe None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.060274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d56d5-8c29-4e1f-9d20-01d64ef88333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.060935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d56d5-8c29-4e1f-9d20-01d64ef88333 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.061248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d56d5-8c29-4e1f-9d20-01d64ef88333 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.061522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d56d5-8c29-4e1f-9d20-01d64ef88333 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/aa51dcbe21f04f24887beb458edb1dce/roles/858c9a6a274b4003940fa3798a1d4ec2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.075487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d56d5-8c29-4e1f-9d20-01d64ef88333 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=aa51dcbe21f04f24887beb458edb1dce, role_id=858c9a6a274b4003940fa3798a1d4ec2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.076912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d56d5-8c29-4e1f-9d20-01d64ef88333 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.093866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 292/593] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:56 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/aa51dcbe21f04f24887beb458edb1dce/roles/858c9a6a274b4003940fa3798a1d4ec2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:57.094786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d56d5-8c29-4e1f-9d20-01d64ef88333 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.116327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c811265-bdf6-4327-abe0-8643e5c6fbb6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.176552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.177234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.177692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.177963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.190540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.192114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.194471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:57.211167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:57.212151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:57.213092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:57.213092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:57.213092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:57.217074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 302/594] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:57.218028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.231304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d56d5-8c29-4e1f-9d20-01d64ef88333 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.272862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.282307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.283171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.283593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.284716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.295061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.296498 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:57.310402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:57.311302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 293/595] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:57.313354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.354123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7d2e7-9e79-4baf-bd8e-ffa248fb36c5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.396160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.397091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.397373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.397645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.398378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:57.398683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.400124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.423150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 303/596] 10.222.0.45 () {56 vars in 1139 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:57.424007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.458339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a2599-289a-418f-8f8d-9af41f14811f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.499338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.500826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.501339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.501807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.503402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:57.504224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.505836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.509547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.522424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 294/597] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:57.524066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.550580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5ccc4-008e-4b35-80d9-7f390711c910 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.553327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.586313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.587107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.587454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.587843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.588629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:57.589090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.590572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.603730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 304/598] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:57.604621 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.640370 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f746af1-73f8-4c40-9e19-037febca73d1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.678918 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.679902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.680370 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.680787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.692463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.694153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:57.710670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:57.711822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:57.712737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:57.712737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:57.712737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:57.719086 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 295/599] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:57.720214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.726133 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5817e8-8b5e-4a27-ad12-e8acfa6f9824 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.762649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.763296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.763638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.763977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.772343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.773940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.775167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:57.787591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:57.788579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:57.789770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 305/600] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:57.790282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.833344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:57.839117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ca34-bb4b-4d80-8764-90759e706c7e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.876477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef9a2-5413-4b5a-8531-c371619274bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.878233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef9a2-5413-4b5a-8531-c371619274bd None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.878714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef9a2-5413-4b5a-8531-c371619274bd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.879689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef9a2-5413-4b5a-8531-c371619274bd None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/4becd85ee7bb4920996dfe7b919aaa71/roles/858c9a6a274b4003940fa3798a1d4ec2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.896166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ef9a2-5413-4b5a-8531-c371619274bd None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=4becd85ee7bb4920996dfe7b919aaa71, role_id=858c9a6a274b4003940fa3798a1d4ec2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.898093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ef9a2-5413-4b5a-8531-c371619274bd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:57.913309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 296/601] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:57 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/4becd85ee7bb4920996dfe7b919aaa71/roles/858c9a6a274b4003940fa3798a1d4ec2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:46:57.914497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef9a2-5413-4b5a-8531-c371619274bd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:57.916271 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0648f-60e7-48f3-bf84-61b39e9998bc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:57.984529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:57.985187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:57.986211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:57.986211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:57.986816 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:57.987058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:57.991214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.021826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 306/602] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:58.028211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.036101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.041010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef9a2-5413-4b5a-8531-c371619274bd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.087418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.088680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.089200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.090672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.091642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:58.093016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.096381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.132723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 297/603] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:58.138733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.172299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.194457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313ce0a-c92b-4e5a-9e7b-8c3c109a417e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.246213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d2fdf-ca51-4e20-b557-a3aa9a1ad14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.246801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2fdf-ca51-4e20-b557-a3aa9a1ad14c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.247082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2fdf-ca51-4e20-b557-a3aa9a1ad14c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.247349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d2fdf-ca51-4e20-b557-a3aa9a1ad14c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.256149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d2fdf-ca51-4e20-b557-a3aa9a1ad14c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.257770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d2fdf-ca51-4e20-b557-a3aa9a1ad14c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-cc7d2fdf-ca51-4e20-b557-a3aa9a1ad14c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:46:58.269092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:58.270106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:58.271070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 307/604] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:58.272150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd96f3-a12f-4784-af0f-368d5195bffc None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.272150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd96f3-a12f-4784-af0f-368d5195bffc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.272323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd96f3-a12f-4784-af0f-368d5195bffc None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.273748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 308/605] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:46:58.275628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd96f3-a12f-4784-af0f-368d5195bffc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.317015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c8c7c-8186-4a36-a302-ee0dc95ce68f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.358756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bcfc4-5873-4f0e-bcca-4547572dfc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.359764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcfc4-5873-4f0e-bcca-4547572dfc57 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.360268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcfc4-5873-4f0e-bcca-4547572dfc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.360813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bcfc4-5873-4f0e-bcca-4547572dfc57 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/bcb79c07e68446d19ac3aeb2279fd887/roles/858c9a6a274b4003940fa3798a1d4ec2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.379142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bcfc4-5873-4f0e-bcca-4547572dfc57 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=bcb79c07e68446d19ac3aeb2279fd887, role_id=858c9a6a274b4003940fa3798a1d4ec2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.381382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bcfc4-5873-4f0e-bcca-4547572dfc57 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.388852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd96f3-a12f-4784-af0f-368d5195bffc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.403480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 298/606] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:58 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/bcb79c07e68446d19ac3aeb2279fd887/roles/858c9a6a274b4003940fa3798a1d4ec2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:46:58.409295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daa0f6-5505-4124-9547-cb762bd83943 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.409295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daa0f6-5505-4124-9547-cb762bd83943 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.409295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daa0f6-5505-4124-9547-cb762bd83943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.443996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-67daa0f6-5505-4124-9547-cb762bd83943 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:58.445956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-67daa0f6-5505-4124-9547-cb762bd83943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:58.453020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.453253 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.453730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.453987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.455092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.455092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:58.455298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.456797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.487643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 309/607] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:46:58.493967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.505184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:58.536716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 299/608] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:58.634463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45683d-fefc-4b7d-b350-fecdc88eed56 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:58.669241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5602d-0d18-419d-9611-cc66e63e8ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:58.669895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5602d-0d18-419d-9611-cc66e63e8ef4 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:58.670168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5602d-0d18-419d-9611-cc66e63e8ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:58.670436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5602d-0d18-419d-9611-cc66e63e8ef4 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/3a1f548368994994a2966b7818e8b0e9/roles/858c9a6a274b4003940fa3798a1d4ec2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:58.685574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5602d-0d18-419d-9611-cc66e63e8ef4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=3a1f548368994994a2966b7818e8b0e9, role_id=858c9a6a274b4003940fa3798a1d4ec2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:58.687017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5602d-0d18-419d-9611-cc66e63e8ef4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:58.701696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 310/609] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:46:58 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/3a1f548368994994a2966b7818e8b0e9/roles/858c9a6a274b4003940fa3798a1d4ec2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:46:58.885519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daa0f6-5505-4124-9547-cb762bd83943 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:58.991589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daa0f6-5505-4124-9547-cb762bd83943 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.027598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ed9a6-55ee-43dd-b469-648d66b7045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.028596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed9a6-55ee-43dd-b469-648d66b7045d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.029142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed9a6-55ee-43dd-b469-648d66b7045d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.029637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed9a6-55ee-43dd-b469-648d66b7045d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.040415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ed9a6-55ee-43dd-b469-648d66b7045d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-577ed9a6-55ee-43dd-b469-648d66b7045d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:46:59.045618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:59.046598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:46:59.047475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:59.050136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 300/610] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:59.050287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.056809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5602d-0d18-419d-9611-cc66e63e8ef4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.127541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.190441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5602d-0d18-419d-9611-cc66e63e8ef4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.227091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a693daf-7ee8-4996-9177-c3ef8d983aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.227693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693daf-7ee8-4996-9177-c3ef8d983aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.227965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693daf-7ee8-4996-9177-c3ef8d983aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.228232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693daf-7ee8-4996-9177-c3ef8d983aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.228881 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a693daf-7ee8-4996-9177-c3ef8d983aa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:59.229286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a693daf-7ee8-4996-9177-c3ef8d983aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.230744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a693daf-7ee8-4996-9177-c3ef8d983aa3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.239924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 311/611] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:59.246391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ed9a6-55ee-43dd-b469-648d66b7045d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.397498 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ed9a6-55ee-43dd-b469-648d66b7045d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.441615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.442325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.442608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.442882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.457669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.459176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.469493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bf08-7a3d-4829-a258-a97f1bebf399 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.469979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bf08-7a3d-4829-a258-a97f1bebf399 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.470058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1bf08-7a3d-4829-a258-a97f1bebf399 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.471588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 312/612] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:46:59.480337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e7cf2-86a0-44fd-92bf-96eab68f0100 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.480337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e7cf2-86a0-44fd-92bf-96eab68f0100 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.480337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e7cf2-86a0-44fd-92bf-96eab68f0100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:46:59.480660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:59.481586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:46:59.482492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:46:59.482492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:46:59.482492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:46:59.482492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 301/613] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:59.489536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.512722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-620e7cf2-86a0-44fd-92bf-96eab68f0100 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:46:59.513946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-620e7cf2-86a0-44fd-92bf-96eab68f0100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:46:59.570808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.614643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 313/614] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:46:59.668860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b537ef-41dc-412e-895b-e82b480cf2b3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.717672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.718294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.718576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.718851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.719496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:46:59.719796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.721195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.734574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 302/615] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:46:59.740163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e7cf2-86a0-44fd-92bf-96eab68f0100 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.817723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:46:59.885645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e7cf2-86a0-44fd-92bf-96eab68f0100 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:46:59.927353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:46:59.927903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:46:59.928179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:46:59.928449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:46:59.935646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:46:59.937221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:46:59.949436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:46:59.950442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:46:59.951408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 314/616] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:46:59.958771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:46:59.992743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.153231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1d46-d1dc-4308-97ba-8b0f092b4a3d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.164752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.190525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f21fab-d1b9-441c-9752-efb0b504bb78 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.198198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.200879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.201532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.201817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.202088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.202826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:00.203132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.204545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.233306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520d14e-b32a-4d26-b960-ab72fbb1d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.234351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520d14e-b32a-4d26-b960-ab72fbb1d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.234802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520d14e-b32a-4d26-b960-ab72fbb1d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.235249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520d14e-b32a-4d26-b960-ab72fbb1d0c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.242399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 303/617] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:00.246894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.261951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520d14e-b32a-4d26-b960-ab72fbb1d0c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6520d14e-b32a-4d26-b960-ab72fbb1d0c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:00.267480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:00.268374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:00.269290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:00.275748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 315/618] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:46:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:00.280096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520d14e-b32a-4d26-b960-ab72fbb1d0c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.437517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520d14e-b32a-4d26-b960-ab72fbb1d0c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.445087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164a56c-c5d5-42c4-bdf6-daeb1c4b35dd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.500950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f086a9-9602-4d14-ada7-e1af2914d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.501605 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f086a9-9602-4d14-ada7-e1af2914d3ff None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.501880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f086a9-9602-4d14-ada7-e1af2914d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.502148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f086a9-9602-4d14-ada7-e1af2914d3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.512807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.513497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.513783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.514046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.514708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:00.515009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.516448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.525243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f086a9-9602-4d14-ada7-e1af2914d3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.526670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f086a9-9602-4d14-ada7-e1af2914d3ff None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.533472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 316/619] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:00.538017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-00f086a9-9602-4d14-ada7-e1af2914d3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:00.554395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:00.555412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:00.556322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:00.556322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:00.556322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:00.556322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 304/620] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:00.557076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b00e-567e-4e66-bb0a-353a6ffe9cc1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.557239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b00e-567e-4e66-bb0a-353a6ffe9cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.559572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948b00e-567e-4e66-bb0a-353a6ffe9cc1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.563264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 305/621] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:00.564017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b00e-567e-4e66-bb0a-353a6ffe9cc1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.571469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.591660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.648057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0202-6e4c-4662-ad3f-1478fbeec0e0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.678408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948b00e-567e-4e66-bb0a-353a6ffe9cc1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.683007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab218f-e8a9-42c3-aadf-d8fb7151b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.683637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab218f-e8a9-42c3-aadf-d8fb7151b447 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.683910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab218f-e8a9-42c3-aadf-d8fb7151b447 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.684177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab218f-e8a9-42c3-aadf-d8fb7151b447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.695909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab218f-e8a9-42c3-aadf-d8fb7151b447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.697313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab218f-e8a9-42c3-aadf-d8fb7151b447 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-40ab218f-e8a9-42c3-aadf-d8fb7151b447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:00.712424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:00.714655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:00.716787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:00.716787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:00.716787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:00.716787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 317/622] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:00.717365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.717554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79007e-304d-4e2e-8d6c-ea37dea6aac8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.717554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79007e-304d-4e2e-8d6c-ea37dea6aac8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.717835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.717982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79007e-304d-4e2e-8d6c-ea37dea6aac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.718124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.718124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.718124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:00.718124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.718681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.730604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 306/623] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:00.731447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.734664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-de79007e-304d-4e2e-8d6c-ea37dea6aac8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:00.735996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-de79007e-304d-4e2e-8d6c-ea37dea6aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:00.825118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 318/624] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:00.825493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.826642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79007e-304d-4e2e-8d6c-ea37dea6aac8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:00.848068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80178043-0c40-4c08-99aa-0363ad1385f5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:00.848834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:00.885455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:00.886060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:00.886343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:00.886621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:00.887265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:00.887570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:00.888939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:00.902514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 307/625] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:00.908766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.019988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79007e-304d-4e2e-8d6c-ea37dea6aac8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.077411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed65b2-5539-40f8-9789-b02ba084a078 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.091058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.092024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.092535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.093114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.104519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.106422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.130248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.131294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.131784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.132246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:01.134673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:01.135568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:01.137053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 319/626] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:01.145116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.145889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.147242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:01.160438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:01.161488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:01.162434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:01.164908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:01.165554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 308/627] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:01.171685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.262754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:01.300130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6ec4d-e170-4843-9a5e-b83b1d5fe0f2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.320866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf084b-eafc-40e3-a25a-0144f714220e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.341411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.342623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.343102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.343817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.345358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:01.345962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.348268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.355230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e76395-a90b-4029-a778-14c7beb50db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.355831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e76395-a90b-4029-a778-14c7beb50db2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.356109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e76395-a90b-4029-a778-14c7beb50db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.356376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e76395-a90b-4029-a778-14c7beb50db2 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.357124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e76395-a90b-4029-a778-14c7beb50db2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:01.357429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e76395-a90b-4029-a778-14c7beb50db2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.358825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e76395-a90b-4029-a778-14c7beb50db2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.364516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 320/628] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:01.365904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.376046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 309/629] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:01.377320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8cf10-1833-4255-8b27-e35737c4ed8f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.377867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8cf10-1833-4255-8b27-e35737c4ed8f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.378136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8cf10-1833-4255-8b27-e35737c4ed8f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.380140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 310/630] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:01.380824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8cf10-1833-4255-8b27-e35737c4ed8f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.443812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:01.469959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2daa4b-06d8-4b0a-b08e-871155f3ba30 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.486509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8cf10-1833-4255-8b27-e35737c4ed8f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.498353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:01.504818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de370d8f-8d14-44eb-bfb8-b0100ee91e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.505473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de370d8f-8d14-44eb-bfb8-b0100ee91e44 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.505750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de370d8f-8d14-44eb-bfb8-b0100ee91e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.506021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de370d8f-8d14-44eb-bfb8-b0100ee91e44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.516050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de370d8f-8d14-44eb-bfb8-b0100ee91e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:01.520469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9d65-3d46-48bd-9fef-f8c1a16865f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.521158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9d65-3d46-48bd-9fef-f8c1a16865f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-de370d8f-8d14-44eb-bfb8-b0100ee91e44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:01.521275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:01.522352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:01.523377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:01.524189 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9d65-3d46-48bd-9fef-f8c1a16865f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.524189 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df9d65-3d46-48bd-9fef-f8c1a16865f5 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/5aa9fe4b8abc4a35b5d4540c3c9e3aa7/roles/858c9a6a274b4003940fa3798a1d4ec2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.524352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 321/631] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:01.524352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79f989-3661-42d6-ba11-143d3de1f700 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.524352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79f989-3661-42d6-ba11-143d3de1f700 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.524352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79f989-3661-42d6-ba11-143d3de1f700 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.525518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 322/632] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:01.526521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718aaca-67ac-492c-ac81-3ae279dc64e5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.526811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718aaca-67ac-492c-ac81-3ae279dc64e5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.527064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718aaca-67ac-492c-ac81-3ae279dc64e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.541751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df9d65-3d46-48bd-9fef-f8c1a16865f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7, role_id=858c9a6a274b4003940fa3798a1d4ec2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.543168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df9d65-3d46-48bd-9fef-f8c1a16865f5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.545717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5718aaca-67ac-492c-ac81-3ae279dc64e5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:01.547012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5718aaca-67ac-492c-ac81-3ae279dc64e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:01.555538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 311/633] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:01 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/5aa9fe4b8abc4a35b5d4540c3c9e3aa7/roles/858c9a6a274b4003940fa3798a1d4ec2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:01.556259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9d65-3d46-48bd-9fef-f8c1a16865f5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.653004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 323/634] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:01.653004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718aaca-67ac-492c-ac81-3ae279dc64e5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.669057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df9d65-3d46-48bd-9fef-f8c1a16865f5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.681810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:01.713653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403e8ae-edad-45d7-a03f-8ce9344e9465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.714395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403e8ae-edad-45d7-a03f-8ce9344e9465 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.714676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403e8ae-edad-45d7-a03f-8ce9344e9465 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.714945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403e8ae-edad-45d7-a03f-8ce9344e9465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.784057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718aaca-67ac-492c-ac81-3ae279dc64e5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:01.807740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403e8ae-edad-45d7-a03f-8ce9344e9465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.809569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403e8ae-edad-45d7-a03f-8ce9344e9465 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.817825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:01.835260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e8161-9c44-4ce5-84ee-2372ae02fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:01.836042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8161-9c44-4ce5-84ee-2372ae02fde5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.836417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8161-9c44-4ce5-84ee-2372ae02fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.836817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e8161-9c44-4ce5-84ee-2372ae02fde5 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.837605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e8161-9c44-4ce5-84ee-2372ae02fde5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:01.837978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e8161-9c44-4ce5-84ee-2372ae02fde5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:01.839420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e8161-9c44-4ce5-84ee-2372ae02fde5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:01.850231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 324/635] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:01.851666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975aa1-c226-4ccf-b294-569e00185aef None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:01.852022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975aa1-c226-4ccf-b294-569e00185aef None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:01.852370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975aa1-c226-4ccf-b294-569e00185aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:01.872423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8d975aa1-c226-4ccf-b294-569e00185aef None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:01.873776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8d975aa1-c226-4ccf-b294-569e00185aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:01.945202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 325/636] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:01.948778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 312/637] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:01.949819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403e8ae-edad-45d7-a03f-8ce9344e9465 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.953897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d975aa1-c226-4ccf-b294-569e00185aef None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:01.963215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.077080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d975aa1-c226-4ccf-b294-569e00185aef None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.090284 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403e8ae-edad-45d7-a03f-8ce9344e9465 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.093347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.118711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.120043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.120526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.121293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.134043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.136245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.153640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508b60-b43c-4cd4-8945-153c7a3184bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:02.154165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:02.155094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:02.155989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:02.155989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:02.155989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:02.156160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508b60-b43c-4cd4-8945-153c7a3184bd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.156160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508b60-b43c-4cd4-8945-153c7a3184bd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.156160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508b60-b43c-4cd4-8945-153c7a3184bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.158237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 326/638] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:02.159317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.176463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508b60-b43c-4cd4-8945-153c7a3184bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-12508b60-b43c-4cd4-8945-153c7a3184bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:02.186781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:02.187838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:02.188689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:02.190127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 313/639] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:02.191795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508b60-b43c-4cd4-8945-153c7a3184bd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.285417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf09fbe-9e50-4df2-9af1-6404fb9eda89 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.302264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.335339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.336202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.336803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.337504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.350082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508b60-b43c-4cd4-8945-153c7a3184bd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.355636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.358285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:02.381185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:02.382268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:02.383836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:02.383836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:02.383836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:02.383836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 327/640] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:02.383836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.395483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.396374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.396836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.397331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.398146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:02.398766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.401036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.401928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.417137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 314/641] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:02.417137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.496495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd17567-ba1d-44a8-82d7-6a9bc175eef4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.529752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dc3c4-9a17-4ab8-885c-a42b2bf285fa None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.531566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.532182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.532462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.532734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.533454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:02.533757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.535705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.543648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 328/642] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:02.548967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.557785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.566328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c4d08-1414-40d9-904a-0aeb8153cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.566958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4d08-1414-40d9-904a-0aeb8153cf38 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.567236 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4d08-1414-40d9-904a-0aeb8153cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.567505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4d08-1414-40d9-904a-0aeb8153cf38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.578343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c4d08-1414-40d9-904a-0aeb8153cf38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-945c4d08-1414-40d9-904a-0aeb8153cf38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:02.584639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:02.585759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 315/643] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:02.586661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c4d08-1414-40d9-904a-0aeb8153cf38 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.637023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.659317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7441ed1-8185-4b37-8161-b2073531913e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.695707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.696430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.696710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.697005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.697640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:02.697941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.698051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c4d08-1414-40d9-904a-0aeb8153cf38 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.699302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.716746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 329/644] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:02.716746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.735218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.735848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.736128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.736400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.743842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.745286 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:02.756404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:02.762751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 316/645] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:02.764139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.819165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.834498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ed8c-8ee6-46dd-9478-26d039b7bf8d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.869349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.869906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.870185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.870459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.874459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997188a2-8155-4113-a067-a0daa328a5f1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:02.878831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:02.883252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.885108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:02.905930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:02.907062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:02.908038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:02.908038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:02.908038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:02.908038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 330/646] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:02.908382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:02.916651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:02.917783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:02.918061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:02.918332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:02.918995 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:02.919663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:02.921384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:02.935954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 317/647] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:02.935954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.015299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046d3ae-108c-421c-8e92-797fe65d71f8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.044106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb264d2-1ffe-4689-9b34-09ba1d221ddb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.049913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.050561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.050839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.051107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.055344 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.058674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.060287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:03.071733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:03.072797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 331/648] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:03.078763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.089713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.090184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.090463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.090982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.091448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:03.091745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.093180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.115654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 318/649] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 10 11:47:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:03.115654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.132412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.191577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95efd2c-1536-4475-93ec-721fc230c04f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.220809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117612-0768-4d1f-aa24-d6c1503b72d6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.227300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.227911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.228598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.228873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.229536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:03.230187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.231895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.245054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 332/650] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:03.249285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.262905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.263537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.263809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.264092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.274802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.276849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:03.291702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:03.292720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:03.293682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:03.293682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:03.293682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:03.297625 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 319/651] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:03.298309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.322278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.352264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992df9eb-1197-40f1-9b27-10dc54753178 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.364001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.394857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.395940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.396224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.396638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.397535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:03.397846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.400201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.407941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fda2a-5535-4c9b-9460-e85167bebf2c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.417286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 333/652] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:03.418738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.445969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132253-b8ff-4ef9-9a2b-f7365fc7bb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.446700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132253-b8ff-4ef9-9a2b-f7365fc7bb70 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.447056 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132253-b8ff-4ef9-9a2b-f7365fc7bb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.447329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132253-b8ff-4ef9-9a2b-f7365fc7bb70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.520589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132253-b8ff-4ef9-9a2b-f7365fc7bb70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.522495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132253-b8ff-4ef9-9a2b-f7365fc7bb70 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.523561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf7e3e-dd55-49d8-9661-18ee85c674af None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.545245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.558286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.558911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.559184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.559449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.567497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.568952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:03.580141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:03.581363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 334/653] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:03.582322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.615892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.641867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 320/654] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:03.642958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132253-b8ff-4ef9-9a2b-f7365fc7bb70 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.690989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da67b5-d726-49ac-abcc-87165536bd93 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.724993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.725600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.725873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.726140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.726781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:03.727077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.728431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.740501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 335/655] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:03.741363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.748595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132253-b8ff-4ef9-9a2b-f7365fc7bb70 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.768358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.782108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.782710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.782987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.783258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.783969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=aa51dcbe21f04f24887beb458edb1dce) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:03.784271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.786280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.792029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 321/656] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/role_assignments?user.id=aa51dcbe21f04f24887beb458edb1dce&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:03.792808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.842411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:03.854920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1201e-abca-4c7d-a293-e0206a0808e1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.892202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912641ba-8389-4317-b58c-0c99ed88817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.893023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912641ba-8389-4317-b58c-0c99ed88817c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.893406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912641ba-8389-4317-b58c-0c99ed88817c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.893807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912641ba-8389-4317-b58c-0c99ed88817c None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.894651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912641ba-8389-4317-b58c-0c99ed88817c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:03.895059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912641ba-8389-4317-b58c-0c99ed88817c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.896612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912641ba-8389-4317-b58c-0c99ed88817c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.915582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 336/657] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:03.915582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebb02-8e25-417b-bfd7-37a30e2ec972 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.915582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebb02-8e25-417b-bfd7-37a30e2ec972 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.915582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ebb02-8e25-417b-bfd7-37a30e2ec972 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.915582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 337/658] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:03.915582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ebb02-8e25-417b-bfd7-37a30e2ec972 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:03.926168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89041f-dd51-4e21-b383-709ba7e3ff2a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:03.964425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:03.965299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:03.965562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:03.965934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:03.978263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:03.981048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:03.996848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:03.998789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:03.999882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:03.999882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:03.999882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:03.999882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 322/659] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:03.999882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.043483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ebb02-8e25-417b-bfd7-37a30e2ec972 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.045294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.080161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5887c4-1aba-471e-a1a3-9e04c8267372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.080790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5887c4-1aba-471e-a1a3-9e04c8267372 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.081120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5887c4-1aba-471e-a1a3-9e04c8267372 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.081384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5887c4-1aba-471e-a1a3-9e04c8267372 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.088760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5887c4-1aba-471e-a1a3-9e04c8267372 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.090535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5887c4-1aba-471e-a1a3-9e04c8267372 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9b5887c4-1aba-471e-a1a3-9e04c8267372 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:04.102840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:04.103995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 338/660] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0cc9-75d8-4603-81de-eb4315b777ec None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.109594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0cc9-75d8-4603-81de-eb4315b777ec None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.110478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d0cc9-75d8-4603-81de-eb4315b777ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.123337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da4c8d-83b4-44ee-a278-285f0e568370 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.124946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-133d0cc9-75d8-4603-81de-eb4315b777ec None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:04.126220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-133d0cc9-75d8-4603-81de-eb4315b777ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:04.129168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.162338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234ee78-2aad-4661-ad65-3f5acb86f787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.163066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234ee78-2aad-4661-ad65-3f5acb86f787 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.163418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234ee78-2aad-4661-ad65-3f5acb86f787 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.163729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234ee78-2aad-4661-ad65-3f5acb86f787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.209027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 339/661] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:04.209027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0cc9-75d8-4603-81de-eb4315b777ec None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.252105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234ee78-2aad-4661-ad65-3f5acb86f787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.253944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234ee78-2aad-4661-ad65-3f5acb86f787 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.290517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.329608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d0cc9-75d8-4603-81de-eb4315b777ec None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.363884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 323/662] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:04.363884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234ee78-2aad-4661-ad65-3f5acb86f787 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.372089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.373049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.373516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.373930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.374707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:04.375268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.376993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.391272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.395083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 340/663] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:04.395982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.462644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234ee78-2aad-4661-ad65-3f5acb86f787 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.498859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.499465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.499745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.500014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.500608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428909e4-4bf9-4ec1-802e-0bcdda2a4c43 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.500730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:04.501059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.502789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.506578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.525124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 324/664] 10.222.0.45 () {56 vars in 1139 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:04.526489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.535649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.536287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.536564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.536835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.548084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.549571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:04.564070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:04.565752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:04.566830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:04.566830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:04.566830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:04.569893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 341/665] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:04.570755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.623371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.637003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cde8c5-e3ab-4f57-b9cc-61b2227e63b2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.673361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.673992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.674271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.674536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.678197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08554e7e-679d-44c3-951c-a7cb741f3564 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.681993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.683415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:04.694759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:04.700373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 325/666] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:04.701559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.722342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25d31c-d50c-44cc-8874-582f4afa9788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.723074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25d31c-d50c-44cc-8874-582f4afa9788 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.723424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25d31c-d50c-44cc-8874-582f4afa9788 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.723773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25d31c-d50c-44cc-8874-582f4afa9788 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.735524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25d31c-d50c-44cc-8874-582f4afa9788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2f25d31c-d50c-44cc-8874-582f4afa9788 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:04.741322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:04.742540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:04.743575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:04.744361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 342/667] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:04.745134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25d31c-d50c-44cc-8874-582f4afa9788 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.767422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.820967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0ab0-f44e-4d5c-8c43-5b6c7ecf76f4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.855789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25d31c-d50c-44cc-8874-582f4afa9788 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:04.856105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d114d1-cfbd-4a0e-b5e8-e99e34d17d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.856715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d114d1-cfbd-4a0e-b5e8-e99e34d17d2f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.857023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d114d1-cfbd-4a0e-b5e8-e99e34d17d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.857462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d114d1-cfbd-4a0e-b5e8-e99e34d17d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.865857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:04.889775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407164dd-6365-455a-8624-d03716a363ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:04.890376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407164dd-6365-455a-8624-d03716a363ca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:04.890653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407164dd-6365-455a-8624-d03716a363ca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:04.890925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407164dd-6365-455a-8624-d03716a363ca None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:04.891550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407164dd-6365-455a-8624-d03716a363ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:04.891849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407164dd-6365-455a-8624-d03716a363ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.893239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407164dd-6365-455a-8624-d03716a363ca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.906416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 343/668] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:04.907194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407164dd-6365-455a-8624-d03716a363ca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:04.938979 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d114d1-cfbd-4a0e-b5e8-e99e34d17d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:04.940419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d114d1-cfbd-4a0e-b5e8-e99e34d17d2f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:04.999003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.008244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407164dd-6365-455a-8624-d03716a363ca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.043157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.043830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.044194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.044468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.045180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:05.045488 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.046917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.053736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 326/669] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:05.054759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d114d1-cfbd-4a0e-b5e8-e99e34d17d2f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.061829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 344/670] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.062818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.099094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d114d1-cfbd-4a0e-b5e8-e99e34d17d2f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.174165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ff1a0-816d-49bf-8cd3-eeb69f612d4f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.198260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.198853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.199129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.199398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.200043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:05.200340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.201721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.209264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.209895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.210174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.215211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.215331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 327/671] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.215331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.222038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.223491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.232898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:05.234819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:05.235743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 345/672] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:05.237290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.323770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cfc69-3647-48eb-9de6-7ae6f8297389 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.337598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.348943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c556d9-ab23-48ea-aa10-4d344c7af80f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.359317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.359948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.360227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.360507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.371283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.372715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.384697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.385331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.385614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.385888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.386607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=4becd85ee7bb4920996dfe7b919aaa71) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:05.386915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.388337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:05.389133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:05.390255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:05.391363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:05.391363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:05.391363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:05.395893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 328/673] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:05.396927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.397103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 346/674] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/role_assignments?user.id=4becd85ee7bb4920996dfe7b919aaa71&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.397871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.507310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.536085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2ddc8-48d0-49f4-aba0-edd440027859 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.546913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bba53-bb7d-4ba3-ae50-f4d526d25ad1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.585568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.586091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.586367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.586637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.587094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.587325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:05.587628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.587926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.588273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.588616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.589792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.601740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 347/675] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.602392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.603367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.605018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.620107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:05.620855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:05.622080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:05.623163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:05.623163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:05.623163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:05.623163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 329/676] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:05.629157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.726583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd36ee-f591-4fd2-99a3-555661fcf265 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.751472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7a25f-ae6c-481d-9b84-022134cc2301 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.764223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.765109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.765535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.765898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.766783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:05.767182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.768699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.778293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.782017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 348/677] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.783572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.796768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.797618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.798050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.798611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.800475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=bcb79c07e68446d19ac3aeb2279fd887) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:05.801236 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.802993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.814965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 330/678] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/role_assignments?user.id=bcb79c07e68446d19ac3aeb2279fd887&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.822876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:05.879683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:05.907217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a15347-8710-4814-8d79-c369c9b27a24 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:05.947403 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:05.948229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:05.948605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:05.948993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:05.949772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:05.950264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:05.951851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:05.966052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 349/679] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:05.975431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.009064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc8358-e913-4538-95aa-f6853a8fc707 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.056429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.058108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.058397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.058788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.069691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:06.071143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:06.085266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:06.086443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:06.087364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:06.087364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:06.087364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:06.087364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:06.087364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:06.087364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:06.087364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:06.087364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:06.090359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 331/680] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:06.103750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.138145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133aaf-25b7-4cb9-921d-58b9e2425d63 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.163540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.184229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6f805-80a4-4195-81cd-f5dab58ad164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.185220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f805-80a4-4195-81cd-f5dab58ad164 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.185717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f805-80a4-4195-81cd-f5dab58ad164 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.186450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f805-80a4-4195-81cd-f5dab58ad164 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.189454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.197402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6f805-80a4-4195-81cd-f5dab58ad164 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:06.199706 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6f805-80a4-4195-81cd-f5dab58ad164 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2be6f805-80a4-4195-81cd-f5dab58ad164 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:06.216163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:06.217332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:06.218274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:06.221143 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 350/681] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:06.223181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8f81-f5fc-4b84-8277-8e9d89d2ec17 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.223591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8f81-f5fc-4b84-8277-8e9d89d2ec17 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.223985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc8f81-f5fc-4b84-8277-8e9d89d2ec17 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.225630 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 351/682] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:06.229419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8f81-f5fc-4b84-8277-8e9d89d2ec17 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.235239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187f5fc-b8bc-4f88-8d47-5f2022d22cf0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.273348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40959166-bdcd-4d97-8a04-4509cc264e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.274115 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959166-bdcd-4d97-8a04-4509cc264e0f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.274496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959166-bdcd-4d97-8a04-4509cc264e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.274903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959166-bdcd-4d97-8a04-4509cc264e0f None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.275857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40959166-bdcd-4d97-8a04-4509cc264e0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:06.276270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40959166-bdcd-4d97-8a04-4509cc264e0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:06.278018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40959166-bdcd-4d97-8a04-4509cc264e0f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:06.297886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 332/683] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:06.297886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffab7-b4d3-4d2e-b725-97c7c40e137b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.297886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffab7-b4d3-4d2e-b725-97c7c40e137b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.297886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ffab7-b4d3-4d2e-b725-97c7c40e137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.317886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-449ffab7-b4d3-4d2e-b725-97c7c40e137b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:06.319388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-449ffab7-b4d3-4d2e-b725-97c7c40e137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:06.370619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc8f81-f5fc-4b84-8277-8e9d89d2ec17 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.398507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 333/684] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:06.399835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ffab7-b4d3-4d2e-b725-97c7c40e137b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.415562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.416850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.417318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.417889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.418876 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:06.419576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:06.421562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:06.438767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.452231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 352/685] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 10 11:47:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:06.462673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.545681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.585871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ffab7-b4d3-4d2e-b725-97c7c40e137b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.601147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1ddb-a424-443d-89e9-f7e0df923fd4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.644651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cdf27-48f2-4456-b0e0-99e3cac8a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.646275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cdf27-48f2-4456-b0e0-99e3cac8a92f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.647797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cdf27-48f2-4456-b0e0-99e3cac8a92f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.649504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cdf27-48f2-4456-b0e0-99e3cac8a92f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.664212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.665159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.665674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.666140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:06.667064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=3a1f548368994994a2966b7818e8b0e9) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:06.669412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:06.670866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:06.680344 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 334/686] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:06 2022] GET /identity/v3/role_assignments?user.id=3a1f548368994994a2966b7818e8b0e9&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:06.694862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.747050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cdf27-48f2-4456-b0e0-99e3cac8a92f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:06.748909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09cdf27-48f2-4456-b0e0-99e3cac8a92f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:06.828950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.888698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 353/687] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:06.898150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cdf27-48f2-4456-b0e0-99e3cac8a92f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:06.936327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:06.942044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580644fb-febf-4548-afb8-45fc6afbf578 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:06.990847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0ffb5-5cdb-4ff5-a0fe-74e2d7baf17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:06.992012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ffb5-5cdb-4ff5-a0fe-74e2d7baf17d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:06.992299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ffb5-5cdb-4ff5-a0fe-74e2d7baf17d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:06.992578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ffb5-5cdb-4ff5-a0fe-74e2d7baf17d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.006912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0ffb5-5cdb-4ff5-a0fe-74e2d7baf17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6cf0ffb5-5cdb-4ff5-a0fe-74e2d7baf17d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:07.013886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:07.014833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:07.015723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:07.016390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 335/688] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:07.021265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0ffb5-5cdb-4ff5-a0fe-74e2d7baf17d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.022828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cdf27-48f2-4456-b0e0-99e3cac8a92f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.069376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.070059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.070347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.070622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.086095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.087898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:07.105742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:07.106717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:07.107622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:07.107622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:07.107622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:07.107622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 354/689] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:07.113789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.119305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:07.157022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0ffb5-5cdb-4ff5-a0fe-74e2d7baf17d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.194155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.194769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.195077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.195457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.196224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:07.196620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.198149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.207296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 336/690] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:07.212845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.240116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:07.248475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d59d4d-e8fd-4018-a2e7-87347bbbcc92 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.284229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.285033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.285418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.285801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.286540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:07.287116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.288452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.306115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 355/691] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:07.308818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.341747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab15e7-503c-4855-9030-fa20e0c0ee23 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.380557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.381383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.381799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.382192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.391266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:07.397808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.400100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:07.431087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:07.432190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:07.433181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:07.433181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:07.433181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:07.435681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 337/692] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:07.443204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.483590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b033b4-f8c9-4183-94cb-dba5527f97b1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.540784 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.541860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.542346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.542869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.558046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.559859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:07.578704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:07.579645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:07.580583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:07.580583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:07.580583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:07.580583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:07.580583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:07.580583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:07.580583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:07.580583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:07.583225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 356/693] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:07.587906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:07.589598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.647283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61adb1-06ce-4557-b6ff-7b10627a848f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.719327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.720345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.720836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.721358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.722730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:07.723539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.726814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.742778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 338/694] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:07.748525 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.771018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624d5e-33af-4502-b3ce-7865ddd80798 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.813356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:07.850572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.851210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.851509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.851788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.852459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:07.852765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.854265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.860664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7efbb-cff7-45a6-8f57-338df82e441b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:07.880542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 357/695] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:07.886278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:07.893967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:07.905309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:07.905309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:07.905309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:07.905309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:07.918659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:07.920109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:07.938206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:07.939220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:07.940852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 339/696] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:07.951463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.053896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05071bb4-258b-486a-8c59-d706758adf5a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.109580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c714b2-df04-4283-9fc8-4031fe2c95f4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.145010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.145260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331a1b2-e9ee-4a40-914c-4e8d0ecf61f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.145649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.145828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331a1b2-e9ee-4a40-914c-4e8d0ecf61f8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.145931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.146128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331a1b2-e9ee-4a40-914c-4e8d0ecf61f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.146249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.146410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331a1b2-e9ee-4a40-914c-4e8d0ecf61f8 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.146895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:08.147178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331a1b2-e9ee-4a40-914c-4e8d0ecf61f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:08.147282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.147489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331a1b2-e9ee-4a40-914c-4e8d0ecf61f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.148631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.148913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331a1b2-e9ee-4a40-914c-4e8d0ecf61f8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.167874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 358/697] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/role_assignments?user.id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:08.171355 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 340/698] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:08.176999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.197741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb07314-0786-40c3-ba1c-ee2b6777705a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.198280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb07314-0786-40c3-ba1c-ee2b6777705a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.198280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb07314-0786-40c3-ba1c-ee2b6777705a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.200105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 341/699] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:08.206615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702446f9-825d-4e51-bcb4-b3067db2eac5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.206941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702446f9-825d-4e51-bcb4-b3067db2eac5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.207288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702446f9-825d-4e51-bcb4-b3067db2eac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.236306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-702446f9-825d-4e51-bcb4-b3067db2eac5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:08.237642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-702446f9-825d-4e51-bcb4-b3067db2eac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:08.275952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.304681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.334077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 342/700] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:08.351577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae9750-31b0-4829-ad41-fd437d5cb4f1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.355644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151a7b-ab55-4b57-8a1c-9210cdc1e8e8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.356216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151a7b-ab55-4b57-8a1c-9210cdc1e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.356706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0151a7b-ab55-4b57-8a1c-9210cdc1e8e8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.358376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 343/701] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:08.364048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52cea-3e21-44b3-83f3-3f735451e588 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.364638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52cea-3e21-44b3-83f3-3f735451e588 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.365154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52cea-3e21-44b3-83f3-3f735451e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.388572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c5a52cea-3e21-44b3-83f3-3f735451e588 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:08.391033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c5a52cea-3e21-44b3-83f3-3f735451e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:08.428581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c46c6-eec8-48c1-9596-23769fe0d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.429236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c46c6-eec8-48c1-9596-23769fe0d7ea None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.429659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c46c6-eec8-48c1-9596-23769fe0d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.429958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c46c6-eec8-48c1-9596-23769fe0d7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.493001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 344/702] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 10 11:47:08.524686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c46c6-eec8-48c1-9596-23769fe0d7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.526234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c46c6-eec8-48c1-9596-23769fe0d7ea None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.577050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.631892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 359/703] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 10 11:47:08.637533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a52cea-3e21-44b3-83f3-3f735451e588 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.640963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c46c6-eec8-48c1-9596-23769fe0d7ea None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.749372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a52cea-3e21-44b3-83f3-3f735451e588 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.761020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c46c6-eec8-48c1-9596-23769fe0d7ea None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.774753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.796027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.797288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.797719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.798154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.809383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.811070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.817772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.818413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.818693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.818967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.824736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:08.829634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.831096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:08.833002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:08.835558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:08.836466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:08.836466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:08.836466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:08.836466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 360/704] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:08.838675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:08.854714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:08.855753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:08.856717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:08.856717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:08.856717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:08.856717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 345/705] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:08.856960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:08.946680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4760-2ad9-4993-a907-cc732244d588 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.979673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc387a9-238a-494c-aeed-9b2ebb42a408 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:08.983542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:08.984446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:08.984924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:08.985402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:08.986244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:08.988349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:08.999996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:09.001116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:09.002475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:09.004851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 361/706] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:09.005797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.027248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.027864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.028143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.028419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.029569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:09.029875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.031249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.049063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 346/707] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:09.050760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.083325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.092756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.142180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01d99e-1ebd-43c5-9ad1-fd71539d7e4e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.184753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.185343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00e1b-0745-418e-b6b0-00af71c77e30 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.185791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.186209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.186651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.187569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:09.188809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.190464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.206334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 362/708] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:09.207363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.234930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.235581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.236313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.236665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.238251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:09.239306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.241189 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.252872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 347/709] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:09.254764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.335574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82501557-e6c1-4e90-85df-a8b27f6787a4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.363237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.368868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.376072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096aecd-e09e-47c2-bf97-5c924bfc7ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.377182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096aecd-e09e-47c2-bf97-5c924bfc7ced None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.377530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096aecd-e09e-47c2-bf97-5c924bfc7ced None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.377873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096aecd-e09e-47c2-bf97-5c924bfc7ced None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.379041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096aecd-e09e-47c2-bf97-5c924bfc7ced None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.380551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096aecd-e09e-47c2-bf97-5c924bfc7ced None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.388473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821d8e6-44d1-4558-a795-f609703ffc14 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.409787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 363/710] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:47:09 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:09.410869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096aecd-e09e-47c2-bf97-5c924bfc7ced None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.427219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.428157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.428632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.429151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.437367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.439307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:09.453076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:09.454097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:09.454997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:09.454997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:09.454997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:09.454997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:09.454997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:09.454997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:09.454997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:09.454997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:09.458527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 348/711] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:09.465296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.557166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096aecd-e09e-47c2-bf97-5c924bfc7ced None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.599335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f4a1a-c741-4543-bf7b-b24b74ca4b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.599851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f4a1a-c741-4543-bf7b-b24b74ca4b3b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.600135 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f4a1a-c741-4543-bf7b-b24b74ca4b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.600410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f4a1a-c741-4543-bf7b-b24b74ca4b3b None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.601102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f4a1a-c741-4543-bf7b-b24b74ca4b3b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:09.601409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f4a1a-c741-4543-bf7b-b24b74ca4b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.602781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5381b-f7f5-45a6-a515-ffc0a4378c65 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.602897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f4a1a-c741-4543-bf7b-b24b74ca4b3b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.617001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 364/712] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:09.617001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc8c5-a034-434f-8989-1e7b106f2817 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.617001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc8c5-a034-434f-8989-1e7b106f2817 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.617001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dc8c5-a034-434f-8989-1e7b106f2817 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.617001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 365/713] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:09.621380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a615c-f74b-474c-822e-2aa4aee2f24a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.621662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a615c-f74b-474c-822e-2aa4aee2f24a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.621973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a615c-f74b-474c-822e-2aa4aee2f24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.645677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-666a615c-f74b-474c-822e-2aa4aee2f24a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:09.646917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-666a615c-f74b-474c-822e-2aa4aee2f24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:09.667129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.667761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.668082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.668359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.669223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:09.669529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.671079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.685955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 349/714] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:09.692313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:09.703470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.704488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:09.745150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 366/715] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:09.811686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60825e34-b884-4fa3-8e97-c2a1079f7e6e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:09.850533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:09.851101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:09.851387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:09.851677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:09.852389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=aa51dcbe21f04f24887beb458edb1dce) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:09.852704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:09.854174 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:09.860563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 350/716] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:09 2022] GET /identity/v3/role_assignments?user.id=aa51dcbe21f04f24887beb458edb1dce&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:10.062610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a615c-f74b-474c-822e-2aa4aee2f24a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:10.171775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a615c-f74b-474c-822e-2aa4aee2f24a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:10.217059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:10.217059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:10.217059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:10.217059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] PATH_INFO: `/v3/services/network` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:10.217476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:10.218553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:10.234571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:10.235618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:10.236471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:10.239530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 367/717] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:10 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:10.245920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:10.335203 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:10.369012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce649b3-0665-42c0-8ebe-bb0f647b4823 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:10.404034 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff003f-8d07-4cbb-bbf1-e06140531c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:10.404654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff003f-8d07-4cbb-bbf1-e06140531c7b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:10.404932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff003f-8d07-4cbb-bbf1-e06140531c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:10.405230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff003f-8d07-4cbb-bbf1-e06140531c7b None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:10.405857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff003f-8d07-4cbb-bbf1-e06140531c7b None admin] RBAC: Adding query filter params (name=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:10.406158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff003f-8d07-4cbb-bbf1-e06140531c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:10.407522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff003f-8d07-4cbb-bbf1-e06140531c7b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:10.413017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 351/718] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:10.426371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:10.503744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:10.587002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccc339-a32b-4074-b4b9-d5ac4bd2c428 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:10.635507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e383ec-f603-4ee4-821b-d45f7b104652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:10.636119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e383ec-f603-4ee4-821b-d45f7b104652 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:10.636400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e383ec-f603-4ee4-821b-d45f7b104652 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:10.636672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e383ec-f603-4ee4-821b-d45f7b104652 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:10.637327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e383ec-f603-4ee4-821b-d45f7b104652 None admin] RBAC: Adding query filter params (type=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:10.637629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e383ec-f603-4ee4-821b-d45f7b104652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:10.639006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e383ec-f603-4ee4-821b-d45f7b104652 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:10.643846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 368/719] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:11.180425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82647cf4-2485-4d5e-af2b-528b582241a1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.180775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82647cf4-2485-4d5e-af2b-528b582241a1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.180886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82647cf4-2485-4d5e-af2b-528b582241a1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.182490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 352/720] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:11.190331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc12d6-f6f5-4d93-855a-2b44461786bf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.190761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc12d6-f6f5-4d93-855a-2b44461786bf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.190856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc12d6-f6f5-4d93-855a-2b44461786bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.217948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9efc12d6-f6f5-4d93-855a-2b44461786bf None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:11.219126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9efc12d6-f6f5-4d93-855a-2b44461786bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:11.303708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 369/721] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:11.575852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82647cf4-2485-4d5e-af2b-528b582241a1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:11.699169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82647cf4-2485-4d5e-af2b-528b582241a1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:11.742681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7118-152f-4199-9112-38acab480969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:11.743305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7118-152f-4199-9112-38acab480969 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.743582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7118-152f-4199-9112-38acab480969 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.743852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c7118-152f-4199-9112-38acab480969 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.746567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:11.759700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c7118-152f-4199-9112-38acab480969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f01c7118-152f-4199-9112-38acab480969 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:11.764447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:11.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:11.766723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 353/722] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:11.771953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc12d6-f6f5-4d93-855a-2b44461786bf None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:11.825026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:11.912671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc12d6-f6f5-4d93-855a-2b44461786bf None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:11.948112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:11.948722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:11.949014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:11.949286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:11.949944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:11.950242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:11.951597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:11.961175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 370/723] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:11.970240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7118-152f-4199-9112-38acab480969 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.128854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c7118-152f-4199-9112-38acab480969 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:12.175304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:12.176208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.176637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.177081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.193249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:12.194934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:12.214274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:12.215589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:12.216750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:12.216750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:12.216750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:12.218269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 354/724] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:12.224310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.364486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:12.376290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca23ea-592e-4932-aa46-cfeb0e18977b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:12.413372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d0d72-fad1-46e2-9565-aa3be83c8a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:12.414030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0d72-fad1-46e2-9565-aa3be83c8a0b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.414312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0d72-fad1-46e2-9565-aa3be83c8a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.414580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d0d72-fad1-46e2-9565-aa3be83c8a0b None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.415218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d0d72-fad1-46e2-9565-aa3be83c8a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:12.415516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d0d72-fad1-46e2-9565-aa3be83c8a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:12.416876 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d0d72-fad1-46e2-9565-aa3be83c8a0b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:12.429821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 371/725] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:12.434823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.472846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb7445-4a14-4382-a05b-a3ed68c53ddf None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.473242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb7445-4a14-4382-a05b-a3ed68c53ddf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.473520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb7445-4a14-4382-a05b-a3ed68c53ddf None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.474993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 372/726] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:12.476061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba96c2-5b7c-4d3a-8fdf-7e2c1dff132a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.476197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba96c2-5b7c-4d3a-8fdf-7e2c1dff132a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.476536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba96c2-5b7c-4d3a-8fdf-7e2c1dff132a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.485025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 373/727] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:12.485025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5cc3-5d7a-4492-8c10-20f9282f5352 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.485025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5cc3-5d7a-4492-8c10-20f9282f5352 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.485025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb5cc3-5d7a-4492-8c10-20f9282f5352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.508774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-59bb5cc3-5d7a-4492-8c10-20f9282f5352 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:12.510056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-59bb5cc3-5d7a-4492-8c10-20f9282f5352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:12.519683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:12.585231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b77128-49c9-412f-98b3-80ed50f8ecff None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:12.599026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 374/728] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:12.600293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330d4d-1dae-403b-be12-49aefa8ff69f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.600573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330d4d-1dae-403b-be12-49aefa8ff69f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.600840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330d4d-1dae-403b-be12-49aefa8ff69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.627639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3b330d4d-1dae-403b-be12-49aefa8ff69f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:12.628802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3b330d4d-1dae-403b-be12-49aefa8ff69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:12.633754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e694ed-27a6-405f-a3b1-930342abde84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:12.634653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e694ed-27a6-405f-a3b1-930342abde84 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.635176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e694ed-27a6-405f-a3b1-930342abde84 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.635650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e694ed-27a6-405f-a3b1-930342abde84 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.645899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e694ed-27a6-405f-a3b1-930342abde84 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:12.647671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e694ed-27a6-405f-a3b1-930342abde84 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b7e694ed-27a6-405f-a3b1-930342abde84 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:12.661791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:12.662750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:12.663703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:12.666330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 355/729] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:12.667772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701147be-d27f-48ba-ae25-7af241ac863f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.668280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701147be-d27f-48ba-ae25-7af241ac863f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.668755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701147be-d27f-48ba-ae25-7af241ac863f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.670603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 356/730] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:12.671694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701147be-d27f-48ba-ae25-7af241ac863f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.705098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 375/731] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:12.705958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1d0e-b4d0-4561-998f-5f5c6b0150c2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.707257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1d0e-b4d0-4561-998f-5f5c6b0150c2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.707539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a1d0e-b4d0-4561-998f-5f5c6b0150c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.743340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9d3a1d0e-b4d0-4561-998f-5f5c6b0150c2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:12.744513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9d3a1d0e-b4d0-4561-998f-5f5c6b0150c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:12.765305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:12.870912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 376/732] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:12.886398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a1d0e-b4d0-4561-998f-5f5c6b0150c2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:12.890761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701147be-d27f-48ba-ae25-7af241ac863f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:12.902493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:12.959660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:12.960511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:12.960934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:12.961362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:12.962215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:12.962705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:12.965478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:12.996128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 357/733] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 10 11:47:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:13.001984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.046628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a1d0e-b4d0-4561-998f-5f5c6b0150c2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.081912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2cb95-cb8d-4391-8b02-dfa60d72f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.083189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2cb95-cb8d-4391-8b02-dfa60d72f09c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.083667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2cb95-cb8d-4391-8b02-dfa60d72f09c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.084257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2cb95-cb8d-4391-8b02-dfa60d72f09c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.097635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2cb95-cb8d-4391-8b02-dfa60d72f09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-00f2cb95-cb8d-4391-8b02-dfa60d72f09c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:13.102595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:13.103500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:13.104348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 377/734] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:13.105067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2cb95-cb8d-4391-8b02-dfa60d72f09c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.117330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.139098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e660d-63a0-4245-86e9-1b4763439f1a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.178137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23533638-65c5-406e-b4b8-26fd1cbe92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.179251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23533638-65c5-406e-b4b8-26fd1cbe92b5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.179671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23533638-65c5-406e-b4b8-26fd1cbe92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.180236 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23533638-65c5-406e-b4b8-26fd1cbe92b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.210285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2cb95-cb8d-4391-8b02-dfa60d72f09c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.218779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.254337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1cf6-7545-40ad-9bac-c513aa746190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.254972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1cf6-7545-40ad-9bac-c513aa746190 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.255249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1cf6-7545-40ad-9bac-c513aa746190 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.255522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1cf6-7545-40ad-9bac-c513aa746190 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.259310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23533638-65c5-406e-b4b8-26fd1cbe92b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.260752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23533638-65c5-406e-b4b8-26fd1cbe92b5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.267447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b1cf6-7545-40ad-9bac-c513aa746190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-210b1cf6-7545-40ad-9bac-c513aa746190 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:13.273397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:13.274370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:13.275231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 378/735] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:13.276012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1cf6-7545-40ad-9bac-c513aa746190 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.340174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.374879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 358/736] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 10 11:47:13.374879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23533638-65c5-406e-b4b8-26fd1cbe92b5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.388172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1cf6-7545-40ad-9bac-c513aa746190 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.425912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.426909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.427450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.427896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.428695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:13.429313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.430949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.432855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.441466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 379/737] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:13.442585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.481393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23533638-65c5-406e-b4b8-26fd1cbe92b5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.517490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2d35-ad32-4929-82f6-cc6d3d50abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.518176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2d35-ad32-4929-82f6-cc6d3d50abb1 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.518452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2d35-ad32-4929-82f6-cc6d3d50abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.518721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b2d35-ad32-4929-82f6-cc6d3d50abb1 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.519362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2d35-ad32-4929-82f6-cc6d3d50abb1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.520733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b2d35-ad32-4929-82f6-cc6d3d50abb1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.537994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 359/738] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:47:13 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:13.539171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2d35-ad32-4929-82f6-cc6d3d50abb1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.571005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29a67c-5fd0-449e-9b62-53cce57e6b4b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.600696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.618657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.619417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.619767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.620121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.620913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:13.621311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.622720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.633942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 380/739] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:13.634813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.663056 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b2d35-ad32-4929-82f6-cc6d3d50abb1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.692482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.708502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.709183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.709464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.709728 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.721432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.723096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.748657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e24568-e0c7-4835-8b97-6bb90ffbbfe6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.788922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b798-baad-40f0-bcfd-fccea765d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.789639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b798-baad-40f0-bcfd-fccea765d622 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.790004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b798-baad-40f0-bcfd-fccea765d622 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.790274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b798-baad-40f0-bcfd-fccea765d622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.802496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b798-baad-40f0-bcfd-fccea765d622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:13.806131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b798-baad-40f0-bcfd-fccea765d622 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1524b798-baad-40f0-bcfd-fccea765d622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:13.821346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:13.822352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:13.823308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:13.823308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:13.823308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:13.825313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 381/740] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:13.826957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c9746-863e-4672-977a-c21a92e3468d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.827479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c9746-863e-4672-977a-c21a92e3468d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.827849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c9746-863e-4672-977a-c21a92e3468d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:13.829449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 382/741] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:13.830750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c9746-863e-4672-977a-c21a92e3468d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:13.854144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:13.855315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:13.856552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:13.856552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:13.856552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:13.856552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 360/742] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:13.856552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:13.878504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:13.951503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c9746-863e-4672-977a-c21a92e3468d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.965279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05d3c-fb4b-4775-8455-74e60e806132 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:13.988482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:13.989257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:13.989603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:13.989945 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.000643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.002434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.002688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7f52c-be2d-4bbf-bcca-ce724132addf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.003353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7f52c-be2d-4bbf-bcca-ce724132addf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.003697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7f52c-be2d-4bbf-bcca-ce724132addf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.004031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7f52c-be2d-4bbf-bcca-ce724132addf None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.004731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7f52c-be2d-4bbf-bcca-ce724132addf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:14.005127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7f52c-be2d-4bbf-bcca-ce724132addf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.006520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7f52c-be2d-4bbf-bcca-ce724132addf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:14.017286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:14.019015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:14.019992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:14.019992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:14.019992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:14.024238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 361/744] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:14.024350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 383/744] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:14.025227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.025625 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a23d54-c7d8-45b0-b8e1-77b9c7431d40 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.025836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a23d54-c7d8-45b0-b8e1-77b9c7431d40 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.026094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a23d54-c7d8-45b0-b8e1-77b9c7431d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.044165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-35a23d54-c7d8-45b0-b8e1-77b9c7431d40 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:14.045377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-35a23d54-c7d8-45b0-b8e1-77b9c7431d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:14.075747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:14.121024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 362/745] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 10 11:47:14.121024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a23d54-c7d8-45b0-b8e1-77b9c7431d40 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.132831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:14.150454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c858d2-7247-4b69-9aa0-3e46b6fe884b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.199868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.201200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.201629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.202351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.203141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:14.203820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.206133 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.227767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a23d54-c7d8-45b0-b8e1-77b9c7431d40 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.228646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 384/746] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:14.230622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.269419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.271417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.271878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.272309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.281552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.284304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:14.303023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:14.304199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:14.305412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:14.307585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 363/747] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:14.308497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.347147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:14.349224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e7d97-0f49-4603-a959-27ddd7354b82 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.385578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.386352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.386723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.387087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.387874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:14.388266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.390280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.402432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 385/748] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:14.403289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.415072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:14.436848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201353a-096a-419d-af32-1a939d1feb18 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.476769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.477435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.477723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.478001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.484675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.486139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:14.498257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:14.499153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 364/749] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:14.500041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.519214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f419-2289-48f7-b825-3c465bf23edd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.554386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.554922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.555197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.555465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.556180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:14.556486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.557939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.576583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 386/750] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:14.577405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.590920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:14.607366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cdac7-4527-477a-9b89-62a0d3dcaa7e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.643512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305215f7-cd8f-43af-afa9-ffa0c57abc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.644388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305215f7-cd8f-43af-afa9-ffa0c57abc42 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.645171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:14.645391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305215f7-cd8f-43af-afa9-ffa0c57abc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.645855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305215f7-cd8f-43af-afa9-ffa0c57abc42 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.647035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305215f7-cd8f-43af-afa9-ffa0c57abc42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.649492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305215f7-cd8f-43af-afa9-ffa0c57abc42 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.666202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 365/751] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:47:14 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:14.667883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305215f7-cd8f-43af-afa9-ffa0c57abc42 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.684264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecbc37-d44b-4337-b5f5-8cf5eb95ff33 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.735343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.737161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.737607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.738037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.749301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.752744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:14.768775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:14.769819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:14.770760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:14.773177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 387/752] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:14.774414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.806621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305215f7-cd8f-43af-afa9-ffa0c57abc42 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.863682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.864306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.864586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.864895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.865777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:14.866084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.867626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.883388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 366/753] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:14.883859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:14.892832 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:14.906975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9d761-abd8-491c-a24d-b5b68e60b776 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:14.934745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:14.948104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:14.948846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:14.949173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:14.949450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:14.960642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:14.962247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:14.977473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:14.978437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:14.979339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:14.979339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:14.979339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:14.979339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 388/754] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:14.984196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:15.002966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffdc1b-8474-4d71-b7f3-fa8ba68674fd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:15.044323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:15.045306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.046041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.046701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.047661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:15.048258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:15.050505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:15.072673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 367/755] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:15.074371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:15.093553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24947dda-4822-4246-a36c-e269421ba35c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:15.136827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:15.137952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.138369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.138780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.140286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:15.140750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:15.142915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:15.146690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:15.152457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 389/756] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:14 2022] GET /identity/v3/role_assignments?user.id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:15.154042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:15.208881 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:15.209964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbb6c0-3cab-49cb-98f6-be0053061020 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:15.279082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:15.279712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.279987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.280256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.280904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:15.281227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:15.282600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:15.313668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 368/757] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:15.319733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:15.322002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd60b-e3d9-4d28-a799-024c2d069c00 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:15.365849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fadef-d6d7-41d3-af88-53391c5d9176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:15.366815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fadef-d6d7-41d3-af88-53391c5d9176 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.367361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fadef-d6d7-41d3-af88-53391c5d9176 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.367636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fadef-d6d7-41d3-af88-53391c5d9176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.455707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fadef-d6d7-41d3-af88-53391c5d9176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:15.457991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764fadef-d6d7-41d3-af88-53391c5d9176 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:15.471769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69dca-dda1-4353-adf4-246a3afc63bd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:15.503567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:15.524104 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:15.547660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:15.547867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.548135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.548404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.561788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:15.563275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:15.573676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 390/758] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:15.578762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fadef-d6d7-41d3-af88-53391c5d9176 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:15.584479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:15.585435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:15.586920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 369/759] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:15.593058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:15.698806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fadef-d6d7-41d3-af88-53391c5d9176 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:15.738811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:15.738811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.739080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.739336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.747646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:15.753289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:15.754968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:15.770519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:15.771483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:15.772398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:15.772398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:15.772398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:15.774628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 391/760] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:15.785987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:15.790941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05208df8-e640-4c2c-8c6e-1b5164292431 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:15.850227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:15.850844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.851128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.851400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.852154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:15.852466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:15.854022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:15.883748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 370/761] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:15.889532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:15.912313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78fa3a-247f-405d-8c5f-fb750a3b3321 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:15.954202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:15.956721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:15.957756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:15.958381 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:15.960105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:15.961636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:15.963275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:15.986643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 392/762] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:15.988698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:15.994270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:16.068402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddfc6e-e4e8-461f-9179-97d601e01222 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:16.072799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:16.104801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba5e1e-6424-49a2-adf8-32e507e21982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:16.105855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba5e1e-6424-49a2-adf8-32e507e21982 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:16.106845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba5e1e-6424-49a2-adf8-32e507e21982 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.107408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba5e1e-6424-49a2-adf8-32e507e21982 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/aa51dcbe21f04f24887beb458edb1dce/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.110658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba5e1e-6424-49a2-adf8-32e507e21982 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=aa51dcbe21f04f24887beb458edb1dce, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:16.113319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba5e1e-6424-49a2-adf8-32e507e21982 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:16.133281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 371/763] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:15 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/aa51dcbe21f04f24887beb458edb1dce/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:47:16.135000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42078dc-6bf9-4a60-be5c-dca11bdd55ac None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:16.135535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42078dc-6bf9-4a60-be5c-dca11bdd55ac None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.136062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42078dc-6bf9-4a60-be5c-dca11bdd55ac None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.138168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 372/764] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:16.147501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddafa87-ead8-4416-9665-3f22f9876d4f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:16.158606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a2866-aa38-442e-aa7f-8164d8eb719a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:16.159221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a2866-aa38-442e-aa7f-8164d8eb719a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.159713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a2866-aa38-442e-aa7f-8164d8eb719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.208556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1b8a2866-aa38-442e-aa7f-8164d8eb719a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:16.210246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1b8a2866-aa38-442e-aa7f-8164d8eb719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:16.348887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:16.349581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:16.351021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.351299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.363626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:16.365168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:16.372346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 373/765] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:16.378405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:16.379587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:16.380546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 393/766] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:16.385347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a2866-aa38-442e-aa7f-8164d8eb719a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:16.421336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:16.491600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a2866-aa38-442e-aa7f-8164d8eb719a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:16.528320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:16.528927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:16.529241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.529516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.530206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:16.530575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:16.532009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:16.544919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 374/767] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:16.550889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:16.665641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bdb2d-757a-49e6-976d-43ca076157f6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:16.676525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:16.700877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:16.701510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:16.701796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:16.702130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:16.702913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=31d1decf1f0a47e3bfdb8f7cc8d3d98c) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:16.703217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:16.704693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:16.711090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 394/768] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:16 2022] GET /identity/v3/role_assignments?user.id=31d1decf1f0a47e3bfdb8f7cc8d3d98c&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:16.912043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.013011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.022220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92640c9-ea3d-41f2-b3ee-c05d8aec3950 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.073482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be66d7f-d6a5-401f-b9c8-bf2fb6fd2f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.074051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66d7f-d6a5-401f-b9c8-bf2fb6fd2f56 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.074325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66d7f-d6a5-401f-b9c8-bf2fb6fd2f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.074591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be66d7f-d6a5-401f-b9c8-bf2fb6fd2f56 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.075170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be66d7f-d6a5-401f-b9c8-bf2fb6fd2f56 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.076520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be66d7f-d6a5-401f-b9c8-bf2fb6fd2f56 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-2be66d7f-d6a5-401f-b9c8-bf2fb6fd2f56 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:17.090780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:17.091876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:17.092746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:17.095105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 375/769] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Oct 10 11:47:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:17.101841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.195095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330822d7-471d-439e-be87-24c75dc445fd None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.195422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330822d7-471d-439e-be87-24c75dc445fd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.195649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330822d7-471d-439e-be87-24c75dc445fd None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.197267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 376/770] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:17.203403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c849c-1643-4caa-b72b-7d236f81c464 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.203692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c849c-1643-4caa-b72b-7d236f81c464 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.203964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c849c-1643-4caa-b72b-7d236f81c464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.242477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b87c849c-1643-4caa-b72b-7d236f81c464 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:17.244035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b87c849c-1643-4caa-b72b-7d236f81c464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:17.293590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae026c4-924a-43cc-b581-73ba89b6a44b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.352393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.352940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.353229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.353499 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.354125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:17.354421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.355779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.367035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 395/771] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:17.372591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.383777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 377/772] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:17.447130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.536703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d43e8-5445-484c-b5c1-1ed90ce68309 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.584702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.585366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.585640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.585906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.586531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:17.586825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.588181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.593377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 396/773] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:17.599151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c849c-1643-4caa-b72b-7d236f81c464 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.694766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.717334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.730264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c849c-1643-4caa-b72b-7d236f81c464 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.782704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3cdb7-6e80-4138-a7ab-30152bc5cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.783439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cdb7-6e80-4138-a7ab-30152bc5cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.783717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cdb7-6e80-4138-a7ab-30152bc5cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.783984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cdb7-6e80-4138-a7ab-30152bc5cbe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.784674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3cdb7-6e80-4138-a7ab-30152bc5cbe3 None admin] RBAC: Adding query filter params (interface=public, service_id=79bf121d6c814f4cb784a0c279fce838, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:17.785003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3cdb7-6e80-4138-a7ab-30152bc5cbe3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.786366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3cdb7-6e80-4138-a7ab-30152bc5cbe3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.796575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 378/774] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/endpoints?service_id=79bf121d6c814f4cb784a0c279fce838&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:17.799114 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa001ed9-7ae9-4eaa-b2a8-8609cce260c2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.799401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa001ed9-7ae9-4eaa-b2a8-8609cce260c2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.799673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa001ed9-7ae9-4eaa-b2a8-8609cce260c2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.801498 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 379/775] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:17.805715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa001ed9-7ae9-4eaa-b2a8-8609cce260c2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:17.862279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0a0be-550a-4496-b350-0d64e99578ee None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.865124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:17.913747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d4071-09f5-4c4a-bb21-b27a04a8a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.915086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4071-09f5-4c4a-bb21-b27a04a8a76e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.915570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4071-09f5-4c4a-bb21-b27a04a8a76e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.916095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4071-09f5-4c4a-bb21-b27a04a8a76e None admin] PATH_INFO: `/v3/services/network` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.917445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d4071-09f5-4c4a-bb21-b27a04a8a76e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.919295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d4071-09f5-4c4a-bb21-b27a04a8a76e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-068d4071-09f5-4c4a-bb21-b27a04a8a76e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:17.931308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:17.932295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:17.933174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:17.933939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa001ed9-7ae9-4eaa-b2a8-8609cce260c2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:17.934970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 397/776] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:17.936872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b681-05a4-43b4-9cef-dad5b7fe3cdb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.936872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b681-05a4-43b4-9cef-dad5b7fe3cdb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.937085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0b681-05a4-43b4-9cef-dad5b7fe3cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.963586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-60b0b681-05a4-43b4-9cef-dad5b7fe3cdb None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:17.965780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-60b0b681-05a4-43b4-9cef-dad5b7fe3cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:17.974890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13aa3-618d-460e-a19f-4ddb46cd2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:17.976024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13aa3-618d-460e-a19f-4ddb46cd2b11 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:17.976357 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13aa3-618d-460e-a19f-4ddb46cd2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:17.976634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d13aa3-618d-460e-a19f-4ddb46cd2b11 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:17.977325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d13aa3-618d-460e-a19f-4ddb46cd2b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:17.979176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d13aa3-618d-460e-a19f-4ddb46cd2b11 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:17.985418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 380/777] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:17.986311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13aa3-618d-460e-a19f-4ddb46cd2b11 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.018967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:18.069828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 398/778] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:18.150319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d13aa3-618d-460e-a19f-4ddb46cd2b11 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.187208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.187817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.188152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.188423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.189647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:18.189949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:18.191300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.196310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 381/779] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:18.201772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0b681-05a4-43b4-9cef-dad5b7fe3cdb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.302954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:18.310822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0b681-05a4-43b4-9cef-dad5b7fe3cdb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.349872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.350758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.351202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.351614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.352374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] RBAC: Adding query filter params (type=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:18.352812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:18.354343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.359839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 399/780] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:18.365838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.416894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.458251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:18.499446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45395266-d027-4e54-8798-35ea73f9eff0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.571156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.572001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.572422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.573857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.574700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] RBAC: Adding query filter params (interface=public, service_id=f682c9e7ea0b4f93a82781d7c1e41c5f, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:18.576610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:18.579692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.590621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 382/781] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/endpoints?service_id=f682c9e7ea0b4f93a82781d7c1e41c5f&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:18.596576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.613352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea050b-45db-46e6-bed2-43f1c8a69d5f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.673992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aae21-87b6-4b39-b573-9d24e1a55e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.674870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aae21-87b6-4b39-b573-9d24e1a55e50 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.675289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aae21-87b6-4b39-b573-9d24e1a55e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.675701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aae21-87b6-4b39-b573-9d24e1a55e50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.686939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519aae21-87b6-4b39-b573-9d24e1a55e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-519aae21-87b6-4b39-b573-9d24e1a55e50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:18.692304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:18.693469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:18.694516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:18.696819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 400/782] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:18.698279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a6163-920b-47fd-81c3-1c8ad9c4bf78 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.698702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a6163-920b-47fd-81c3-1c8ad9c4bf78 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.699130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a6163-920b-47fd-81c3-1c8ad9c4bf78 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.701936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 401/783] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:18.702836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a6163-920b-47fd-81c3-1c8ad9c4bf78 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:18.729855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:18.739556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992db4e-6141-4f45-9a8a-83fd0e62beee None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.776457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a257e2-ba59-4166-bbc9-d06f18f9b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.777113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a257e2-ba59-4166-bbc9-d06f18f9b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.777398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a257e2-ba59-4166-bbc9-d06f18f9b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.777669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a257e2-ba59-4166-bbc9-d06f18f9b2c0 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.778266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a257e2-ba59-4166-bbc9-d06f18f9b2c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:18.779611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a257e2-ba59-4166-bbc9-d06f18f9b2c0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.785621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 383/784] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:18.786788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4a09-2833-4bd4-b5cb-e86296328f23 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.787074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4a09-2833-4bd4-b5cb-e86296328f23 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.787345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa4a09-2833-4bd4-b5cb-e86296328f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.806646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-50fa4a09-2833-4bd4-b5cb-e86296328f23 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:18.807847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-50fa4a09-2833-4bd4-b5cb-e86296328f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:18.810045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:18.833942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a6163-920b-47fd-81c3-1c8ad9c4bf78 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:18.875937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:18.877219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:18.877812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:18.878298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:18.879189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:18.879649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:18.880289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 384/785] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:18.881769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:18.892621 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 402/786] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:18.897817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4a09-2833-4bd4-b5cb-e86296328f23 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.032882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa4a09-2833-4bd4-b5cb-e86296328f23 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.067559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.068192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.068471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.068743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.075633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.079221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.081631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:19.097590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:19.098566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:19.100024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:19.100024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:19.100024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:19.100024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 385/787] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:19.104689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.208259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.233049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ce963-d251-451b-97df-2edfc32e1530 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.265476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.271423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089979c-cda4-4cfb-8c3a-5074317c7cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.272054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089979c-cda4-4cfb-8c3a-5074317c7cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.272333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089979c-cda4-4cfb-8c3a-5074317c7cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.272603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089979c-cda4-4cfb-8c3a-5074317c7cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.273299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089979c-cda4-4cfb-8c3a-5074317c7cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:19.273605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089979c-cda4-4cfb-8c3a-5074317c7cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.275034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089979c-cda4-4cfb-8c3a-5074317c7cc2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.288547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 403/788] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:19.289843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d89a2-5178-41be-bf9d-e82acbf99d4c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.290129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d89a2-5178-41be-bf9d-e82acbf99d4c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.290399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d89a2-5178-41be-bf9d-e82acbf99d4c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.300258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 404/789] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:19.300258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d89a2-5178-41be-bf9d-e82acbf99d4c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.381660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e57f9-55d8-4c73-85e1-2b07c8a2384d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.413424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d89a2-5178-41be-bf9d-e82acbf99d4c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.419879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b910d-d2bc-44f4-8bdc-a3e0e2221aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.420510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b910d-d2bc-44f4-8bdc-a3e0e2221aab None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.420847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b910d-d2bc-44f4-8bdc-a3e0e2221aab None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.421153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b910d-d2bc-44f4-8bdc-a3e0e2221aab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.433300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b910d-d2bc-44f4-8bdc-a3e0e2221aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a71b910d-d2bc-44f4-8bdc-a3e0e2221aab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:19.438374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:19.439402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:19.440267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 386/790] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:19.441489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf54cd-f92c-49c3-8bef-893f6cc7aa4a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.441489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf54cd-f92c-49c3-8bef-893f6cc7aa4a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.441644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf54cd-f92c-49c3-8bef-893f6cc7aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.459285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.460374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.460755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.461162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.461871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cadf54cd-f92c-49c3-8bef-893f6cc7aa4a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:19.463401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cadf54cd-f92c-49c3-8bef-893f6cc7aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:19.475936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.477465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:19.490333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:19.491300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:19.492282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:19.496121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 405/791] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:19.497082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.499912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.522061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.546082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 387/792] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:19.547381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf54cd-f92c-49c3-8bef-893f6cc7aa4a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.651217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf54cd-f92c-49c3-8bef-893f6cc7aa4a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.687335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.688308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.688809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.689304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.690238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:19.690829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.692426 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.703181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da81f9-d3e9-41e4-a1ad-7f1368193dec None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.711854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 388/793] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:19.728229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.760132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.760753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.761057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.761337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.762003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:19.762307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.763687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.781516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 406/794] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:19.787892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.809932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.885346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:19.910459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fd806-14c8-42dd-804a-5dcfcaf07693 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.921452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1e05c-15af-43c4-8101-0bdc2fb8303b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:19.946338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.947401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.947877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.948341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.958837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:19.960135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.960805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:19.961176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:19.961453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:19.962452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.975244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:19.976791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:19.980465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:19.981501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:19.982600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:19.982600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:19.982600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:19.984471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 389/795] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:19.985463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:19.996918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:19.998099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:19.999111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:19.999111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:19.999111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:19.999111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 407/796] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:19.999656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.086846 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.100091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f889d-2409-4a3b-a069-b205d14f071d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.108426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f1d13-00a5-4714-86c1-0b601c55245e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.124700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.141175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50544e6-50c4-4a70-a6a5-f71aa8c1780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.142595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50544e6-50c4-4a70-a6a5-f71aa8c1780f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.143018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50544e6-50c4-4a70-a6a5-f71aa8c1780f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.143429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50544e6-50c4-4a70-a6a5-f71aa8c1780f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.145058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.145677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.145949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.146223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.147080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:20.147195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.148825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.155561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50544e6-50c4-4a70-a6a5-f71aa8c1780f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a50544e6-50c4-4a70-a6a5-f71aa8c1780f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:20.160796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:20.161953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:20.162926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:20.169018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 408/798] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.169018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.169308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 390/798] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:20.171979 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50544e6-50c4-4a70-a6a5-f71aa8c1780f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.273751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d7270-6e26-4e4c-9626-05c4d7c1dc8b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.282870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50544e6-50c4-4a70-a6a5-f71aa8c1780f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.310030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.310636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.310909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.311177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.311811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:20.312107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.313500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.322031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.322980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.323407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.323849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.324658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:20.325163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.326675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.330052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 409/799] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.330963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.341031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 391/800] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:20.342441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.359415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.366827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.432340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab441d-a3a6-4bcb-8ecd-47f9ad15ec17 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.459327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf49e0c-5576-47a1-9d83-73b582d4c1b7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.466028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.466658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.466932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.467198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.473972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.475401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:20.486899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:20.487990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 410/801] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:20.489062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.499878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.500727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.501559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.502013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.510430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.512064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:20.525071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:20.526175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:20.527220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:20.529029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 392/802] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:20.529933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.584759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.590844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba432c41-69c3-4b0a-baa0-1600b3c933af None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.612524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.628865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.629529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.629793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.630057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.640803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.642811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.651296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de293c-f012-4088-ad9c-4418039bac3f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:20.656834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:20.658047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:20.659102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:20.659102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:20.659102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:20.662707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 411/803] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:20.663553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.692537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.693510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.693959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.694374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.695335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:20.695792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.697442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.711364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 393/804] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.712387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.766415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ddc24-bf1c-4f5d-a6e9-9cbfa9a05444 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.799783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78e505-a40e-408a-a4b8-0a434cc6f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.800386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78e505-a40e-408a-a4b8-0a434cc6f697 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.800664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78e505-a40e-408a-a4b8-0a434cc6f697 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.800933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78e505-a40e-408a-a4b8-0a434cc6f697 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.801685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78e505-a40e-408a-a4b8-0a434cc6f697 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:20.801989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78e505-a40e-408a-a4b8-0a434cc6f697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.805916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78e505-a40e-408a-a4b8-0a434cc6f697 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.829147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 412/805] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.829360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad858a-18b1-4da7-87f5-e916c35ff530 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.829451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8a37-3552-4c59-9bdb-fed726f4dca0 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.829451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8a37-3552-4c59-9bdb-fed726f4dca0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.829451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd8a37-3552-4c59-9bdb-fed726f4dca0 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.829451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 413/806] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:20.829451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd8a37-3552-4c59-9bdb-fed726f4dca0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.838282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.863124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:20.869012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.869644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.869923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.870192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.870824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:20.871123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.872479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.888715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 394/807] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:20.888715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:20.945941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd8a37-3552-4c59-9bdb-fed726f4dca0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:20.985590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f10413-9e69-4028-85cb-5e1739af5b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:20.986254 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f10413-9e69-4028-85cb-5e1739af5b4b None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:20.986532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f10413-9e69-4028-85cb-5e1739af5b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:20.986803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f10413-9e69-4028-85cb-5e1739af5b4b None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/5aa9fe4b8abc4a35b5d4540c3c9e3aa7/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:20.988709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f10413-9e69-4028-85cb-5e1739af5b4b None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:20.990170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f10413-9e69-4028-85cb-5e1739af5b4b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:20.991170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9c6c-3107-4c28-8c33-77a8029e61cd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.004129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 414/808] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:20 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/5aa9fe4b8abc4a35b5d4540c3c9e3aa7/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:21.005465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fda699-f4fe-4200-9457-ad7e0a73e8fc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.005830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fda699-f4fe-4200-9457-ad7e0a73e8fc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.006176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fda699-f4fe-4200-9457-ad7e0a73e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.037771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbd76d-5569-49ad-a72a-245ae603639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.038806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd76d-5569-49ad-a72a-245ae603639a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.039290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd76d-5569-49ad-a72a-245ae603639a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.039771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbd76d-5569-49ad-a72a-245ae603639a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.046759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a0fda699-f4fe-4200-9457-ad7e0a73e8fc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:21.048202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a0fda699-f4fe-4200-9457-ad7e0a73e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:21.117648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.132047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.133356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbd76d-5569-49ad-a72a-245ae603639a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.137240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbd76d-5569-49ad-a72a-245ae603639a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.148999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 415/809] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:21.148999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fda699-f4fe-4200-9457-ad7e0a73e8fc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.287470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fda699-f4fe-4200-9457-ad7e0a73e8fc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.301532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 395/810] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:21.308519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15bfad-5ec9-478e-8b74-167db1fa9fad None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.310108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15bfad-5ec9-478e-8b74-167db1fa9fad None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.310108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15bfad-5ec9-478e-8b74-167db1fa9fad None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.310661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 396/811] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:21.311367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15bfad-5ec9-478e-8b74-167db1fa9fad None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.332886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1427b-c634-4ae7-a4a5-023c70b784a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.333554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1427b-c634-4ae7-a4a5-023c70b784a9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.333834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1427b-c634-4ae7-a4a5-023c70b784a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.334104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1427b-c634-4ae7-a4a5-023c70b784a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.343383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1427b-c634-4ae7-a4a5-023c70b784a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.344841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1427b-c634-4ae7-a4a5-023c70b784a9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f4a1427b-c634-4ae7-a4a5-023c70b784a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:21.357226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:21.358208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:21.359159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 416/812] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:21.361294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eacec-4ee7-48da-aba8-1a12a1787b5b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.361294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eacec-4ee7-48da-aba8-1a12a1787b5b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.361450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eacec-4ee7-48da-aba8-1a12a1787b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.380179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-442eacec-4ee7-48da-aba8-1a12a1787b5b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:21.381402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-442eacec-4ee7-48da-aba8-1a12a1787b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:21.419429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.432329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15bfad-5ec9-478e-8b74-167db1fa9fad None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.434180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.453457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 417/813] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:21.455041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eacec-4ee7-48da-aba8-1a12a1787b5b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.470465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.471094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.471384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.471661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.482683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.484405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:21.500637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:21.502679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:21.503776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:21.503776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:21.503776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:21.507184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 397/814] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:21.507978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.566070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eacec-4ee7-48da-aba8-1a12a1787b5b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.605522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da169-96a9-4429-b272-93facf8a916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.606377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da169-96a9-4429-b272-93facf8a916e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.606831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da169-96a9-4429-b272-93facf8a916e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.607296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985da169-96a9-4429-b272-93facf8a916e None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.608228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985da169-96a9-4429-b272-93facf8a916e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:21.608676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985da169-96a9-4429-b272-93facf8a916e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.610276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985da169-96a9-4429-b272-93facf8a916e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.629585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 418/815] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:21.630139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cca651-49e4-4d3e-977e-35463eb50233 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.630887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da169-96a9-4429-b272-93facf8a916e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.671049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.671741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.672027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.672299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.672881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.675274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.681032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:21.685992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:21.687226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:21.688449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 398/816] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:21.689354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.701248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.747296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985da169-96a9-4429-b272-93facf8a916e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.782070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.783232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.783471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.783746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.784378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:21.784683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.786092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.797481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 419/817] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:21.798744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.806013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d098a-5d06-4549-9738-748546615fd6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.847538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.848195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.848547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.848828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.858990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.860440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:21.876964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:21.877961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:21.878863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:21.878863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:21.878863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:21.885234 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 399/818] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:21.885234 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:21.905961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f8858-3402-4b88-ae54-0c7d941fddca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:21.908833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.943830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:21.944666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:21.945040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:21.945378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:21.946077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:21.946464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:21.947886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:21.950436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:21.957984 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 420/819] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:21.957984 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.005163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126cd9e-fb65-45f8-ae59-849e40834bc8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.044946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.045619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.045895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.046172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.046753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.048164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:22.056957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:22.058021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 10 11:47:22.062293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:22.063204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55bbeb-aa1f-44f3-99a2-9e7a451d9566 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.063294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 400/820] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:22.063294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.097292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.098069 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.098372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.098734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.105534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.106975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:22.118584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:22.119651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 421/821] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:22.120785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.149737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.175354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e69c76-586b-4334-b261-a4ca282ba4a3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.201527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.214580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.215207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.215490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.215765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.216410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.216719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.218119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.231341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 401/822] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.232227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.237529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e443035-e5ab-45c6-a05e-6916790ccbe7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.272844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.273480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.274005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.274005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.274636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.274939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.276338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.286203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 422/823] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.286203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.346955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99aff-b515-4956-b95c-a2248e8e3cc6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.382447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.383039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.383322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.383597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.384259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] RBAC: Adding query filter params (name=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.384569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.385974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.387563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.395354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 402/824] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.395354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.402836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7f83-8f07-4a5c-930e-612f2eab69c1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.442819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.444012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.444695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.444993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.445284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.445973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.446280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.447823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.466060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 423/825] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.466060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.498216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d519e43-9602-4653-9ee4-cedecfe75113 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.533727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.534349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.534639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.534914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.541526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.542960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:22.555279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:22.556170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 403/826] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:22.561743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.575365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1e835-923e-4883-b3e2-7027347babe6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.610464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc78d-bad5-43f1-ac30-0c8d7a4d1f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.611561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc78d-bad5-43f1-ac30-0c8d7a4d1f92 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.611841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc78d-bad5-43f1-ac30-0c8d7a4d1f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.612108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edc78d-bad5-43f1-ac30-0c8d7a4d1f92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.612765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc78d-bad5-43f1-ac30-0c8d7a4d1f92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.614179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edc78d-bad5-43f1-ac30-0c8d7a4d1f92 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.645095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 424/827] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:47:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:22.645095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc78d-bad5-43f1-ac30-0c8d7a4d1f92 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.649732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.688112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024c85e-fb13-46ee-a42d-25f653c0c508 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.703212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.749690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.750676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.751518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.751978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.752797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] RBAC: Adding query filter params (type=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.753340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.754952 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.759282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edc78d-bad5-43f1-ac30-0c8d7a4d1f92 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.762352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 404/828] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.763493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.811500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.811500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.811500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.812196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.812577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=aa51dcbe21f04f24887beb458edb1dce) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.812956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.814762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.830105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 425/829] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/role_assignments?user.id=aa51dcbe21f04f24887beb458edb1dce&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.833033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:22.918461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10784085-a8df-43e7-b813-c25592d3f333 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.948807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:22.962928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:22.963845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:22.964322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:22.964762 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:22.965638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:22.966093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:22.967687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:22.982295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 405/830] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:22.989032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7b69e-4f26-4358-9946-f0080285681c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:22.989231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:23.023203 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:23.030332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf6464-286e-4c12-80e1-eae55cebb4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:23.031123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6464-286e-4c12-80e1-eae55cebb4f1 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.031471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6464-286e-4c12-80e1-eae55cebb4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.031820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf6464-286e-4c12-80e1-eae55cebb4f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.033162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf6464-286e-4c12-80e1-eae55cebb4f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:23.034619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf6464-286e-4c12-80e1-eae55cebb4f1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:23.071682 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 426/831] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:47:22 2022] POST /identity/v3/endpoints => generated 337 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:23.116302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facbdb5-2402-4dec-b8cf-62234fa01cc9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:23.165185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974cb56-cbce-4113-9cf1-e781943a8b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:23.165878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974cb56-cbce-4113-9cf1-e781943a8b1d None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.166160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974cb56-cbce-4113-9cf1-e781943a8b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.166440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974cb56-cbce-4113-9cf1-e781943a8b1d None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/31d1decf1f0a47e3bfdb8f7cc8d3d98c/roles/858c9a6a274b4003940fa3798a1d4ec2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.183724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974cb56-cbce-4113-9cf1-e781943a8b1d None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=31d1decf1f0a47e3bfdb8f7cc8d3d98c, role_id=858c9a6a274b4003940fa3798a1d4ec2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:23.185271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974cb56-cbce-4113-9cf1-e781943a8b1d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:23.201457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 406/832] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:22 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/31d1decf1f0a47e3bfdb8f7cc8d3d98c/roles/858c9a6a274b4003940fa3798a1d4ec2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:23.407861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60239975-7d46-4466-8078-5963eff261da None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.408242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60239975-7d46-4466-8078-5963eff261da None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.408597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60239975-7d46-4466-8078-5963eff261da None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.410091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 427/833] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:23.417101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94b99-64d0-401f-9ad6-fdab97432160 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.417487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94b99-64d0-401f-9ad6-fdab97432160 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.417839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94b99-64d0-401f-9ad6-fdab97432160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.440152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6dc94b99-64d0-401f-9ad6-fdab97432160 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:23.441422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6dc94b99-64d0-401f-9ad6-fdab97432160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:23.518078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 407/834] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:23.796773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60239975-7d46-4466-8078-5963eff261da None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:23.914817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60239975-7d46-4466-8078-5963eff261da None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:23.944376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:23.955051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3791-3ba7-4e58-b251-b26d40b8a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:23.955688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3791-3ba7-4e58-b251-b26d40b8a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:23.955971 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3791-3ba7-4e58-b251-b26d40b8a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:23.956358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3791-3ba7-4e58-b251-b26d40b8a1f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:23.969020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e3791-3ba7-4e58-b251-b26d40b8a1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4b7e3791-3ba7-4e58-b251-b26d40b8a1f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:23.974435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:23.975368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:23.976233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:23.980046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 428/835] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:23.981917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc94b99-64d0-401f-9ad6-fdab97432160 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:23.985899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.087864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc94b99-64d0-401f-9ad6-fdab97432160 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.123179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.123792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.124074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.124346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.125037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:24.125346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.127066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.140510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 408/836] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:24.142112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3791-3ba7-4e58-b251-b26d40b8a1f1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.253222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3791-3ba7-4e58-b251-b26d40b8a1f1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.288102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.288739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.289311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.289594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.301368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.302882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:24.317848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:24.318795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:24.319691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:24.319691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:24.319691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:24.322995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 429/837] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:24.325242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.392959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.428777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb3680-4b24-4c6d-9766-6df933f03671 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.462864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.463478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.463761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.464034 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.464733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:24.465065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.466489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.483536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 409/838] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:24.484960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.530090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.591496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15335fa4-c5b3-44fd-9a6e-3102c26d4259 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.627624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.628256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.628530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.628797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.637472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.638913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:24.650384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:24.651333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:24.652316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 430/839] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:24.657896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.767000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a6a3b-7632-4864-a986-afedf1fcfe82 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.794534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.813636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ec050-e9ba-49e7-94cc-be957249d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.814490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec050-e9ba-49e7-94cc-be957249d756 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.814964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec050-e9ba-49e7-94cc-be957249d756 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.815511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ec050-e9ba-49e7-94cc-be957249d756 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:24.816475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ec050-e9ba-49e7-94cc-be957249d756 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:24.816997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ec050-e9ba-49e7-94cc-be957249d756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:24.818682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ec050-e9ba-49e7-94cc-be957249d756 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:24.841118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 410/840] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:24.843222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:24.943389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:24.947751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9578cc1-8194-43be-a8dc-fb1cc5e6279e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:24.984264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceacd7-cef6-4dc4-bfd3-f792d5df4727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:24.985779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceacd7-cef6-4dc4-bfd3-f792d5df4727 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:24.986302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceacd7-cef6-4dc4-bfd3-f792d5df4727 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:24.986762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcceacd7-cef6-4dc4-bfd3-f792d5df4727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.061754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcceacd7-cef6-4dc4-bfd3-f792d5df4727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.064187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcceacd7-cef6-4dc4-bfd3-f792d5df4727 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.138975 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f56a-9968-4ed5-90fb-92c38f0cdca6 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.139647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f56a-9968-4ed5-90fb-92c38f0cdca6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.140123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f56a-9968-4ed5-90fb-92c38f0cdca6 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.146365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 411/841] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:25.148457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2c16-8615-44ed-a2d9-89d8588c64d9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.148946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2c16-8615-44ed-a2d9-89d8588c64d9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.149492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2c16-8615-44ed-a2d9-89d8588c64d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.167696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cd2f2c16-8615-44ed-a2d9-89d8588c64d9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:25.169220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cd2f2c16-8615-44ed-a2d9-89d8588c64d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:25.169329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.174915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 431/842] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:25.180925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceacd7-cef6-4dc4-bfd3-f792d5df4727 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.257076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 412/843] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:25.257076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d992-4e8e-466d-ad26-90a5e75b4f06 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.257076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d992-4e8e-466d-ad26-90a5e75b4f06 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.257076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8d992-4e8e-466d-ad26-90a5e75b4f06 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.258124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 413/844] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:25.263122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78898f-6581-4fde-b4e6-54c31328b626 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.263412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78898f-6581-4fde-b4e6-54c31328b626 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.263689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78898f-6581-4fde-b4e6-54c31328b626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.282855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6c78898f-6581-4fde-b4e6-54c31328b626 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:25.284047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6c78898f-6581-4fde-b4e6-54c31328b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:25.310457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcceacd7-cef6-4dc4-bfd3-f792d5df4727 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.348080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64ac34-9a04-4c93-b8b7-64224deb29b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.348713 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64ac34-9a04-4c93-b8b7-64224deb29b4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.349088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64ac34-9a04-4c93-b8b7-64224deb29b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.349367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64ac34-9a04-4c93-b8b7-64224deb29b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.359911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64ac34-9a04-4c93-b8b7-64224deb29b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.362038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64ac34-9a04-4c93-b8b7-64224deb29b4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.368461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 414/845] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5c64ac34-9a04-4c93-b8b7-64224deb29b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:25.382419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:25.383420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:25.384315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:25.384315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:25.384315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:25.386103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 432/846] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:25.394490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78898f-6581-4fde-b4e6-54c31328b626 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.445863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.503795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78898f-6581-4fde-b4e6-54c31328b626 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.516147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9430f3-53e9-465d-ac5b-734eee1066e0 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.516483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9430f3-53e9-465d-ac5b-734eee1066e0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.517583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9430f3-53e9-465d-ac5b-734eee1066e0 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.519363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 433/847] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:25.524315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a99d-5b94-4039-aee3-8bec05ed1fec None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.524596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a99d-5b94-4039-aee3-8bec05ed1fec None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.524870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a99d-5b94-4039-aee3-8bec05ed1fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.542402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.543274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3a06a99d-5b94-4039-aee3-8bec05ed1fec None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:25.543510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.543978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.544454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3a06a99d-5b94-4039-aee3-8bec05ed1fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:25.544658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.545563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:25.546124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.547760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.559435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 415/848] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:25.560573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.593656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.615614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 434/849] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:25.616255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a99d-5b94-4039-aee3-8bec05ed1fec None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.678177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296ff52-965d-43c9-ad9e-eaf211ebb5da None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.681342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.715145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.715771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.716052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.716322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.716894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.717787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a99d-5b94-4039-aee3-8bec05ed1fec None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.718290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:25.727793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:25.729007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:25.729865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 416/850] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:25.730661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.759204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.759958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.760304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.760648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.767353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.768758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:25.781734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:25.782687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 435/851] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:25.783636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.830661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:25.854967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756dd5f-b3c5-4cbd-836b-1dafa93b59d5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.889834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae94312-8a61-44b3-a7b1-88eb095bf715 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:25.894847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.895479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.895760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.896034 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.896610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.898006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:25.906768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:25.907730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:25.908648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 417/852] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:25.910229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.923244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:25.923898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:25.924175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:25.924444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:25.925160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:25.925456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:25.926799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:25.931180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 436/853] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:25.931861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:25.941957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.011110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e5a20-f941-4b15-b4d8-5f05be060999 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.027511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d97681-ba74-448d-9f8b-fc952d683d26 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.034455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.044371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.045090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.045372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.045646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.046325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:26.046627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.048554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.059959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 418/854] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.060622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.062313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ddc4-55e6-407b-bc0a-48222129539d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.063139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ddc4-55e6-407b-bc0a-48222129539d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.063986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ddc4-55e6-407b-bc0a-48222129539d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.064262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ddc4-55e6-407b-bc0a-48222129539d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.074849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ddc4-55e6-407b-bc0a-48222129539d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-caa9ddc4-55e6-407b-bc0a-48222129539d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:26.079572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:26.080583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 437/855] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:47:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:26.081486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ddc4-55e6-407b-bc0a-48222129539d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.155852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.165385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf22897-57fa-4d37-8e85-f591753d510d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.177865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ddc4-55e6-407b-bc0a-48222129539d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.198509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.199110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.199391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.199665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.200324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:26.200629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.202013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.206678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 419/856] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.207686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.210727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.211471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.211751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.212019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.212641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:26.212942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.214323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.218855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 438/857] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.220084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.257382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.325946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d16216-3453-4a18-8673-fdb7d2218d34 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.335403 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3a30e-094c-45f4-a4f1-6615a0f050b2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.370483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.371119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.371374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.371647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.372367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:26.372676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.374143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.374910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.376102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.376835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.377510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.378365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:26.378848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.380225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.389142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 420/858] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/role_assignments?user.id=5aa9fe4b8abc4a35b5d4540c3c9e3aa7&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.389142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.394607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 439/859] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.396491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.416353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.523225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.532677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c2a13-7814-4749-95aa-e8a125a16e9b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.536535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a4c52-6019-4ca9-bebf-2b3f5f87cd64 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.578298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.579633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.579958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.580233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.581030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:26.581334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.582877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.583874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.584792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.585544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.585823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.588043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 421/860] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.600055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.601705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:26.618399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:26.619410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:26.620579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:26.620579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:26.620579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:26.620579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 440/861] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:26.627761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.734521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:26.754192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad13cd-8f09-4011-90be-42b3310f14cd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.792805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.793695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.794217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.794629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.795406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:26.795931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.798041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.814955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 422/862] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:26.820807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:26.923967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73a29-94e0-4d59-a812-cae68bb2d375 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:26.958154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:26.959158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:26.959972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:26.960439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:26.968666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:26.970936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:26.982871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:26.983897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:26.984880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:26.988017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 441/863] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:26.993552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.097046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edb5d2-4d1e-48c4-b225-8efd17847b69 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:27.133308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:27.133973 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.134256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.134526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.135247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:27.135547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:27.136956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:27.159785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 423/864] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 10 11:47:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:27.161144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.166142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:27.271066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61716b2-bc12-40a5-91d0-f8968a018e0c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:27.311351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213168c8-d266-4357-bf44-f4900557c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:27.312322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213168c8-d266-4357-bf44-f4900557c927 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.312802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213168c8-d266-4357-bf44-f4900557c927 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.313855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213168c8-d266-4357-bf44-f4900557c927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.384557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213168c8-d266-4357-bf44-f4900557c927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:27.386459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213168c8-d266-4357-bf44-f4900557c927 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:27.389656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:27.487337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 442/865] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:27.493028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.495573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:27.600583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec3d4-b8d6-4329-9c28-e3851d0e3dee None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:27.638619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:27.639620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.640243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.640709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.651136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:27.652795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:27.668231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:27.669211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:27.670110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:27.670110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:27.670110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:27.676893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 424/866] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:27.680843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213168c8-d266-4357-bf44-f4900557c927 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.785742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213168c8-d266-4357-bf44-f4900557c927 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:27.788098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:27.825188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:27.826102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.826624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.827095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:27.827933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:27.828434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:27.830071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:27.842169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 443/867] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:27.848608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:27.904854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:27.953429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055722b-0a5e-4392-b25d-58fbfd039fd8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:27.992555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:27.993214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:27.993493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:27.993765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.000786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:28.002252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:28.013679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:28.014744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:28.015923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 425/868] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:28.022940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:28.126650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17329f05-9c02-4e15-b335-76458ebf1eca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:28.166241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5313-41a9-47f4-bc2c-5c657bd55fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:28.166834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5313-41a9-47f4-bc2c-5c657bd55fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.167078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5313-41a9-47f4-bc2c-5c657bd55fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.167287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5313-41a9-47f4-bc2c-5c657bd55fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.167966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe5313-41a9-47f4-bc2c-5c657bd55fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:28.168265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe5313-41a9-47f4-bc2c-5c657bd55fd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:28.169760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe5313-41a9-47f4-bc2c-5c657bd55fd5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:28.182156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 444/869] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:28.188201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:28.292561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6442b13-5e1b-4c85-8e31-61967aed3cf0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:28.314216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:28.327417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3462ee-d92f-4929-8847-14e372319fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:28.328029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3462ee-d92f-4929-8847-14e372319fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.328307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3462ee-d92f-4929-8847-14e372319fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.328581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3462ee-d92f-4929-8847-14e372319fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.329892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3462ee-d92f-4929-8847-14e372319fd6 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=31d1decf1f0a47e3bfdb8f7cc8d3d98c) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:28.330197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3462ee-d92f-4929-8847-14e372319fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:28.331621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3462ee-d92f-4929-8847-14e372319fd6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:28.337991 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 426/870] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:28 2022] GET /identity/v3/role_assignments?user.id=31d1decf1f0a47e3bfdb8f7cc8d3d98c&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:28.576595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b0c1-0c3f-4c6f-9944-ed908aa669e4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.576898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b0c1-0c3f-4c6f-9944-ed908aa669e4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.577245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b0c1-0c3f-4c6f-9944-ed908aa669e4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.579549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 445/871] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:28.585331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156370c-9884-4f9e-bd72-11fa6d74382c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.585870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156370c-9884-4f9e-bd72-11fa6d74382c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.585870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156370c-9884-4f9e-bd72-11fa6d74382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.607027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3156370c-9884-4f9e-bd72-11fa6d74382c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:28.608252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3156370c-9884-4f9e-bd72-11fa6d74382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:28.682057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 427/872] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:28.711567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20bf2-6d93-4012-a865-4a2717781bda None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.712184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20bf2-6d93-4012-a865-4a2717781bda None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.712664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20bf2-6d93-4012-a865-4a2717781bda None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.714527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 446/873] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:28.720339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035552-9e1e-461a-9920-81e662e07a14 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.720885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035552-9e1e-461a-9920-81e662e07a14 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.721409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035552-9e1e-461a-9920-81e662e07a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.740826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-90035552-9e1e-461a-9920-81e662e07a14 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:28.742261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90035552-9e1e-461a-9920-81e662e07a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:28.822999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 428/874] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:28.923212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6da3d3-5315-46b1-aa09-b5700b37a202 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.923830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6da3d3-5315-46b1-aa09-b5700b37a202 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.924311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6da3d3-5315-46b1-aa09-b5700b37a202 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.926145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 447/875] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:28.931518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319558a-fade-4c29-b6d5-866178b49547 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:28.932039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319558a-fade-4c29-b6d5-866178b49547 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:28.932522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319558a-fade-4c29-b6d5-866178b49547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:28.955123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f319558a-fade-4c29-b6d5-866178b49547 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:28.956630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f319558a-fade-4c29-b6d5-866178b49547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:28.986983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:28.987191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6da3d3-5315-46b1-aa09-b5700b37a202 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.015780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:29.031595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 429/876] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:29.098283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319558a-fade-4c29-b6d5-866178b49547 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.104777 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6da3d3-5315-46b1-aa09-b5700b37a202 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.148194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0a1c0-f6b7-44ac-a426-a8cd5cd0761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.149300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0a1c0-f6b7-44ac-a426-a8cd5cd0761d None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.150043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0a1c0-f6b7-44ac-a426-a8cd5cd0761d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.150522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0a1c0-f6b7-44ac-a426-a8cd5cd0761d None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.151760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0a1c0-f6b7-44ac-a426-a8cd5cd0761d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:29.153360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0a1c0-f6b7-44ac-a426-a8cd5cd0761d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:29.177215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 448/877] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:47:28 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:29.217213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319558a-fade-4c29-b6d5-866178b49547 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.273708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.274367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.274648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.274917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.275505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:29.276887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:29.287313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:29.288487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:29.290081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 430/878] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:29.294530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0a1c0-f6b7-44ac-a426-a8cd5cd0761d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.340145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.378675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:29.409750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:29.431053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0a1c0-f6b7-44ac-a426-a8cd5cd0761d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.469217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.470104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.470545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.471115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.472023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:29.472540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:29.474122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:29.474873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7380d7-9ca1-4761-bd8d-7f9290fa388f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.479780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 449/879] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:29.485582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:29.512100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93408034-1a15-4d1f-8da5-4ec6309c1898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.512858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408034-1a15-4d1f-8da5-4ec6309c1898 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.513270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408034-1a15-4d1f-8da5-4ec6309c1898 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.513752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408034-1a15-4d1f-8da5-4ec6309c1898 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.514462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93408034-1a15-4d1f-8da5-4ec6309c1898 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:29.516669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93408034-1a15-4d1f-8da5-4ec6309c1898 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:29.537138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 431/880] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:47:29 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:47:29.614858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404ac62-918f-4d8a-afde-472bc18c61c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:29.663446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9576f2-db00-498c-bc00-8c353df9f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:29.664411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9576f2-db00-498c-bc00-8c353df9f24a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:29.664901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9576f2-db00-498c-bc00-8c353df9f24a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:29.665399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9576f2-db00-498c-bc00-8c353df9f24a None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:29.666214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9576f2-db00-498c-bc00-8c353df9f24a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:29.666709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9576f2-db00-498c-bc00-8c353df9f24a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:29.668351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9576f2-db00-498c-bc00-8c353df9f24a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:29.674446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 450/881] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:30.587646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4156e-40ab-4887-9c8e-df165c8ae6f9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.588171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4156e-40ab-4887-9c8e-df165c8ae6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.588171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4156e-40ab-4887-9c8e-df165c8ae6f9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.589745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 432/882] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:30.595017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188a14-1b30-4215-a8ab-4241403db84a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:30.595426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188a14-1b30-4215-a8ab-4241403db84a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:30.595575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188a14-1b30-4215-a8ab-4241403db84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:30.613292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-22188a14-1b30-4215-a8ab-4241403db84a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:30.614452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-22188a14-1b30-4215-a8ab-4241403db84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:30.616361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:30.680620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 451/883] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:30.946363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4156e-40ab-4887-9c8e-df165c8ae6f9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.037785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.054359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4156e-40ab-4887-9c8e-df165c8ae6f9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.089410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c66eb-f668-4a9a-bc14-f9439d44e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.090040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c66eb-f668-4a9a-bc14-f9439d44e192 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.090314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c66eb-f668-4a9a-bc14-f9439d44e192 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.090583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c66eb-f668-4a9a-bc14-f9439d44e192 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.101028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c66eb-f668-4a9a-bc14-f9439d44e192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d61c66eb-f668-4a9a-bc14-f9439d44e192 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:31.105842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:31.106812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:31.107681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 433/884] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 10 11:47:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:31.113610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22188a14-1b30-4215-a8ab-4241403db84a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.217107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22188a14-1b30-4215-a8ab-4241403db84a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.252765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.253419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.253693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.253957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.254614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:31.254912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.256278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.261476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.264796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 452/885] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:31.271315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c66eb-f668-4a9a-bc14-f9439d44e192 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.375044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c66eb-f668-4a9a-bc14-f9439d44e192 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.410198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31c31c-ac25-4783-a95d-d14e2b3e996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.410833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31c31c-ac25-4783-a95d-d14e2b3e996b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.411116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31c31c-ac25-4783-a95d-d14e2b3e996b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.411387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31c31c-ac25-4783-a95d-d14e2b3e996b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.421897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31c31c-ac25-4783-a95d-d14e2b3e996b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.423935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31c31c-ac25-4783-a95d-d14e2b3e996b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.432913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0f31c31c-ac25-4783-a95d-d14e2b3e996b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:31.439964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:31.441050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:31.442468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:31.442468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:31.442468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:31.442468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 434/886] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:31.450151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.560783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11442678-0aa1-4e62-9df0-8cc5954015f3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.584151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c0d0-1a50-4ae5-a392-b351581094be None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.584445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c0d0-1a50-4ae5-a392-b351581094be None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.584704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c0d0-1a50-4ae5-a392-b351581094be None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.586329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 435/887] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:31.591343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcfc9-d566-43e5-b02a-e16eee9330ca None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.591875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcfc9-d566-43e5-b02a-e16eee9330ca None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.591875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcfc9-d566-43e5-b02a-e16eee9330ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.596872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.598058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.598514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.599117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.600788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:31.601310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.602873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.612135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e0bfcfc9-d566-43e5-b02a-e16eee9330ca None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:31.613367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e0bfcfc9-d566-43e5-b02a-e16eee9330ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:31.618194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 453/888] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:31.627368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.705417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 436/889] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:31.706398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.751273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc765-79d5-43f9-9a23-9ee42c53c230 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.789312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.790020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.790296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.790564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.802092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.804011 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:31.817302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548280e4-e6bd-4831-b848-a3b2c8319625 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.817826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548280e4-e6bd-4831-b848-a3b2c8319625 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.818301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548280e4-e6bd-4831-b848-a3b2c8319625 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.820132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 437/890] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:31.822097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:31.823080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:31.824056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:31.826072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 454/891] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:31.827004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e5ea-a822-46d9-a25a-d1c670c74260 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.827355 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e5ea-a822-46d9-a25a-d1c670c74260 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.827699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e5ea-a822-46d9-a25a-d1c670c74260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.834028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:31.847595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ab69e5ea-a822-46d9-a25a-d1c670c74260 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:31.849087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab69e5ea-a822-46d9-a25a-d1c670c74260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:31.918961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 438/892] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:31.920509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ceff4-813f-4b7a-9e3c-8c1ff2ed789a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.920794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ceff4-813f-4b7a-9e3c-8c1ff2ed789a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.921100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ceff4-813f-4b7a-9e3c-8c1ff2ed789a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.922523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 439/893] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:31.927473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6a493-499f-4f77-bf8e-025d305af241 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.927976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6a493-499f-4f77-bf8e-025d305af241 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.928446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6a493-499f-4f77-bf8e-025d305af241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.943339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28aad3-fec5-465c-9bf2-342998b88f91 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:31.947381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e0c6a493-499f-4f77-bf8e-025d305af241 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:31.948871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e0c6a493-499f-4f77-bf8e-025d305af241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:31.964529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:31.980390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:31.981021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:31.981309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:31.981582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:31.982303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:31.982607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:31.984092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.001510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 455/894] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 10 11:47:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.002310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.014192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.027565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 440/895] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:32.029835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6a493-499f-4f77-bf8e-025d305af241 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.120939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54c114-6306-4408-9def-431c64b7e8f4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.156326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.156997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.157279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.157548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.158186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.159543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.166431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6a493-499f-4f77-bf8e-025d305af241 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:32.168484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:32.169513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:32.170362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:32.174734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 456/896] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:32.175615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.212341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe07d-2505-4c06-b87c-0aec1e8fcd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.213723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe07d-2505-4c06-b87c-0aec1e8fcd30 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.214017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe07d-2505-4c06-b87c-0aec1e8fcd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.214289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebe07d-2505-4c06-b87c-0aec1e8fcd30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.221463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.277960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.280747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b9207-39fc-4ab0-8593-9bdafa7d8a33 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.290720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebe07d-2505-4c06-b87c-0aec1e8fcd30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.292167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebe07d-2505-4c06-b87c-0aec1e8fcd30 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.314337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.314932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.315208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.315480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.316093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.316639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.317767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.322217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 457/897] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.322947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.392355 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 441/898] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:32.393145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe07d-2505-4c06-b87c-0aec1e8fcd30 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.419840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc919f2-fb2a-4e73-92ef-3c5d3f3b922c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.427001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.455289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c2938-5984-47b9-91cd-f656e7ee7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.456108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2938-5984-47b9-91cd-f656e7ee7308 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.456357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2938-5984-47b9-91cd-f656e7ee7308 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.456772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2938-5984-47b9-91cd-f656e7ee7308 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.457559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c2938-5984-47b9-91cd-f656e7ee7308 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.459426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c2938-5984-47b9-91cd-f656e7ee7308 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.473909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 458/899] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:47:32 2022] POST /identity/v3/services => generated 241 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:32.474692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c2938-5984-47b9-91cd-f656e7ee7308 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.482742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.495514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebe07d-2505-4c06-b87c-0aec1e8fcd30 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.540107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.540750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.541054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.541326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.541938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.543320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:32.553566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:32.554646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:32.555556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 442/900] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:32.556369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.612894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c2938-5984-47b9-91cd-f656e7ee7308 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.656469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.657165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.657443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.657711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.658332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.658635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.659995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.665728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 459/901] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.666555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.666738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302261fe-8a0f-49f1-a774-9d32950b7095 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.701770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.708622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.709367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.709560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.709858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.720699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.722182 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:32.739881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:32.740857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:32.741798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:32.741798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:32.741798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:32.741798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 443/902] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:32.741798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.748806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.779456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba910-0911-4f76-9ac6-1910cd094c48 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.818495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.819111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.819393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.819663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.820295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.820620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.822000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.826866 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 460/903] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.827640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.866094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01a57b-e495-4397-a227-a154d493b1f0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.900435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.901307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.901588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.901858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.902716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] RBAC: Adding query filter params (interface=public, service_id=16c75d79cec04316a5432bbd784df8c0, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.903779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.905167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.916031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 444/904] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/endpoints?service_id=16c75d79cec04316a5432bbd784df8c0&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.916031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:32.928063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.936782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4f5ef-1777-4221-8fc7-47597f6df641 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:32.974324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:32.974932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:32.975252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:32.975527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:32.976160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:32.976472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:32.977856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:32.987499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:32.992105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 461/905] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:32.992988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.029869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924ec34-ac6a-4059-b7a6-cb48bb0cdeac None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.065512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.066122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.066398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.066664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.067281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:33.067580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.068920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.073807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 445/906] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:33.074574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.098486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03fec-2b09-4680-9aac-3ed04d0dc216 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.133286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4714-1fc3-43a6-877b-857b133b60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.133894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4714-1fc3-43a6-877b-857b133b60a4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.134170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4714-1fc3-43a6-877b-857b133b60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.134436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a4714-1fc3-43a6-877b-857b133b60a4 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.135033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4714-1fc3-43a6-877b-857b133b60a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.136378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a4714-1fc3-43a6-877b-857b133b60a4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.142330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 462/907] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:47:32 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:47:33.143094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4714-1fc3-43a6-877b-857b133b60a4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.172712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.206733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9c832-f8bc-41fa-b613-629aee69258c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.241735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.249744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.251229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.251695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.252132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.259818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.261598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.271797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a4714-1fc3-43a6-877b-857b133b60a4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:33.274601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:33.275563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:33.276946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 446/908] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:33.281479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.319580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.320202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.320478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.320745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.321809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] RBAC: Adding query filter params (interface=public, service_id=bedc600dc2334958bae3d15b8ad5923a, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:33.322117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.323712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.338858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 463/909] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/endpoints?service_id=bedc600dc2334958bae3d15b8ad5923a&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:33.340765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.411563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e69307-e2a7-463e-9655-cf219efeb75f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.445376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.452048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.453963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.454613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.455263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.456197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:33.456857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.458703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.469397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ffce4-80e2-4c3d-a1d2-a995d846a3aa None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.473964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 447/910] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:33.483251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:33.515528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312873a-322d-4eb5-99b2-902c9fa21b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.516659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312873a-322d-4eb5-99b2-902c9fa21b60 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.516938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312873a-322d-4eb5-99b2-902c9fa21b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.517255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312873a-322d-4eb5-99b2-902c9fa21b60 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.518138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312873a-322d-4eb5-99b2-902c9fa21b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.520194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312873a-322d-4eb5-99b2-902c9fa21b60 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.529011 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 464/911] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 11:47:33.554004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:33.613890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d9646-9040-43f3-b046-976e9f27fded None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:33.653413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ec010-bdb5-4641-a526-de028d2c494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:33.654030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ec010-bdb5-4641-a526-de028d2c494c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:33.654308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ec010-bdb5-4641-a526-de028d2c494c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:33.654577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ec010-bdb5-4641-a526-de028d2c494c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:33.655366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ec010-bdb5-4641-a526-de028d2c494c None admin] RBAC: Adding query filter params (role.id=9a3be5b2c3364fe9b2da8b1c5fc0ed70, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=31d1decf1f0a47e3bfdb8f7cc8d3d98c) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:33.655675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ec010-bdb5-4641-a526-de028d2c494c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:33.657701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ec010-bdb5-4641-a526-de028d2c494c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:33.669103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 448/912] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:33 2022] GET /identity/v3/role_assignments?user.id=31d1decf1f0a47e3bfdb8f7cc8d3d98c&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=9a3be5b2c3364fe9b2da8b1c5fc0ed70 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:34.662561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfeeb2-700d-4ba1-8d2c-3fda36a6a019 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:34.663115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfeeb2-700d-4ba1-8d2c-3fda36a6a019 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:34.663115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfeeb2-700d-4ba1-8d2c-3fda36a6a019 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:34.664556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 465/913] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:34.670066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49413d-3f8f-4809-8a29-1404c304c1e6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:34.670861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49413d-3f8f-4809-8a29-1404c304c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:34.671375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49413d-3f8f-4809-8a29-1404c304c1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:34.690602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ce49413d-3f8f-4809-8a29-1404c304c1e6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:34.692049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce49413d-3f8f-4809-8a29-1404c304c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:34.760115 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 449/914] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:35.028987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfeeb2-700d-4ba1-8d2c-3fda36a6a019 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:35.135421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfeeb2-700d-4ba1-8d2c-3fda36a6a019 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:35.170786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:35.171804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.172309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.172803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.173611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:35.175196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:35.184293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:35.185328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:35.186183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:35.189490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 466/915] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:35.195742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49413d-3f8f-4809-8a29-1404c304c1e6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:35.242655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:35.299449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49413d-3f8f-4809-8a29-1404c304c1e6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:35.338750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a621a-65e1-4ed2-bbbe-a5a5443dbefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:35.339824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a621a-65e1-4ed2-bbbe-a5a5443dbefc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.340365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a621a-65e1-4ed2-bbbe-a5a5443dbefc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.340859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a621a-65e1-4ed2-bbbe-a5a5443dbefc None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.341750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a621a-65e1-4ed2-bbbe-a5a5443dbefc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:35.342313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a621a-65e1-4ed2-bbbe-a5a5443dbefc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:35.343983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a621a-65e1-4ed2-bbbe-a5a5443dbefc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:35.350090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 450/916] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:35.360451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:35.368690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:35.449687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d655-303b-4d59-8733-2bf9fdfa435e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.450361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d655-303b-4d59-8733-2bf9fdfa435e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.450846 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d655-303b-4d59-8733-2bf9fdfa435e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.452688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 451/917] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:35.458045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2b45-0bce-43f3-9e47-3f0364cf5948 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.458622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2b45-0bce-43f3-9e47-3f0364cf5948 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.459146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2b45-0bce-43f3-9e47-3f0364cf5948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.464626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140bf1d-7b0d-4481-ba15-fa45ab6b4992 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:35.478661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-571d2b45-0bce-43f3-9e47-3f0364cf5948 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:35.480279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-571d2b45-0bce-43f3-9e47-3f0364cf5948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:35.500650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:35.501302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.501568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.501842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.502465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:35.502765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:35.504134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:35.509240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 467/918] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:35.514841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:35.569112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 452/919] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:35.597253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:35.624920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbfc07-1fab-4570-95ab-ff6f267813f2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:35.664751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07c0fe-9885-4566-99e7-7ca33001b0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:35.666106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07c0fe-9885-4566-99e7-7ca33001b0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.666532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07c0fe-9885-4566-99e7-7ca33001b0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.666959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07c0fe-9885-4566-99e7-7ca33001b0a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.667812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07c0fe-9885-4566-99e7-7ca33001b0a0 None admin] RBAC: Adding query filter params (interface=public, service_id=6824a84b86964f73b4d4df42ceebe8c0, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:35.668273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07c0fe-9885-4566-99e7-7ca33001b0a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:35.669809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07c0fe-9885-4566-99e7-7ca33001b0a0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:35.676098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 468/920] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 10 11:47:35 2022] GET /identity/v3/endpoints?service_id=6824a84b86964f73b4d4df42ceebe8c0&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:35.682122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d2b45-0bce-43f3-9e47-3f0364cf5948 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:35.735120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:35.796693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d2b45-0bce-43f3-9e47-3f0364cf5948 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:35.821072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34f9f-af86-4e33-9e42-dd68f384d981 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.821072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34f9f-af86-4e33-9e42-dd68f384d981 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.821072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34f9f-af86-4e33-9e42-dd68f384d981 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.821072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 469/921] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:35.823870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add452c2-aa38-41b5-9467-9b102deb4eb5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.824153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add452c2-aa38-41b5-9467-9b102deb4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.824425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add452c2-aa38-41b5-9467-9b102deb4eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.832674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f2afc-f385-4e39-b0b5-a57573f2a0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:35.833318 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2afc-f385-4e39-b0b5-a57573f2a0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.833600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2afc-f385-4e39-b0b5-a57573f2a0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.833871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2afc-f385-4e39-b0b5-a57573f2a0d4 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.834472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f2afc-f385-4e39-b0b5-a57573f2a0d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:35.835844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f2afc-f385-4e39-b0b5-a57573f2a0d4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:35.845145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 453/922] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:47:35 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:47:35.845145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b9d46-9729-42e9-a822-d9303137180d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.845145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b9d46-9729-42e9-a822-d9303137180d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.845145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b9d46-9729-42e9-a822-d9303137180d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.845985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 454/923] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:35.846890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-add452c2-aa38-41b5-9467-9b102deb4eb5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:35.848188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-add452c2-aa38-41b5-9467-9b102deb4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:35.854740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61321d87-8de5-47a5-ad64-2f44784878e4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:35.855321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61321d87-8de5-47a5-ad64-2f44784878e4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:35.855786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61321d87-8de5-47a5-ad64-2f44784878e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:35.876862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-61321d87-8de5-47a5-ad64-2f44784878e4 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:35.878140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61321d87-8de5-47a5-ad64-2f44784878e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:35.925758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 470/924] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:35.926701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add452c2-aa38-41b5-9467-9b102deb4eb5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:35.977203 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 455/925] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:36.004702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:36.042802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add452c2-aa38-41b5-9467-9b102deb4eb5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.077944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.078544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.078817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.079084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.079663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.081094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:36.090171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:36.091277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:36.092145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 471/926] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:36.097719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61321d87-8de5-47a5-ad64-2f44784878e4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.129761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:36.201159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.201424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61321d87-8de5-47a5-ad64-2f44784878e4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.241924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.242536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.242813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.243082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.243700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:36.243997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.245394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.250962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 456/927] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:36.256425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.321819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727ac1-91d0-4498-b8d7-6a48043c9b21 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.355022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:36.359121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:36.362816 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13011f-8172-4aed-91e3-e3e8640cd593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.363760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13011f-8172-4aed-91e3-e3e8640cd593 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.363999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13011f-8172-4aed-91e3-e3e8640cd593 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.364267 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13011f-8172-4aed-91e3-e3e8640cd593 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.365297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdbbc7-1a56-4d85-bc46-205f9595805d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.377690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13011f-8172-4aed-91e3-e3e8640cd593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9b13011f-8172-4aed-91e3-e3e8640cd593 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:36.382985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:36.383951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:36.384796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 472/928] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:36.385576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13011f-8172-4aed-91e3-e3e8640cd593 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.406177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.407290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.407572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.407844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.408470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:36.408775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.410181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.415068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 457/929] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:36.418174 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.489823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13011f-8172-4aed-91e3-e3e8640cd593 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.522874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.523507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.523787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.524068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.524643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.526048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:36.534774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:36.535701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:36.536595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 473/930] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:36.537929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.545666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edb91c-c1f3-4516-8891-d6245abeb2a2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.581239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.581851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.582130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.582431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.583116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:36.583419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.584772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.593322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 458/931] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:36.594478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.603958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:36.622269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:36.649560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e069ec-ba78-45e1-94eb-84372f3db5ba None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.682813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b5f6a-6c90-4565-931e-a919e27d4611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.683486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b5f6a-6c90-4565-931e-a919e27d4611 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.683684 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b5f6a-6c90-4565-931e-a919e27d4611 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.683956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b5f6a-6c90-4565-931e-a919e27d4611 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.684624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b5f6a-6c90-4565-931e-a919e27d4611 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.686028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b5f6a-6c90-4565-931e-a919e27d4611 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.707678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 474/932] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:47:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:36.708611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c127-05e4-4923-8888-f547f504cf5b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.718123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b5f6a-6c90-4565-931e-a919e27d4611 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.756854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.757220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.757627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.757956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.758677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:36.759042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.760489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.767734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 459/933] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:36.773672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.874068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b5f6a-6c90-4565-931e-a919e27d4611 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.878081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:36.892926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:36.906536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801896a6-089c-4297-8b6e-fe5acc5820cc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:36.920256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.921068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.921330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.922519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.934017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.935484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.949647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:36.950109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:36.951022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:36.953698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:36.953698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:36.953698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:36.953890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:36.953890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:36.953890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:36.953890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:36.954130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 475/934] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:36.954209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:36.954209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:36.959222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:36.961719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 460/935] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:36.967772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:37.071245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace162b-92b1-4641-86ea-c35a88267c84 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:37.097078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17330b2-68a5-4aa2-a000-0480cba22490 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:37.106826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:37.107435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.107710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.108264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.108912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:37.109281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:37.110657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:37.123459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 476/936] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:37.129557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:37.137983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec30660-396c-44ee-8ce1-1bf53cd148d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:37.138598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec30660-396c-44ee-8ce1-1bf53cd148d5 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.138879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec30660-396c-44ee-8ce1-1bf53cd148d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.139153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec30660-396c-44ee-8ce1-1bf53cd148d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.139839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec30660-396c-44ee-8ce1-1bf53cd148d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:37.141745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec30660-396c-44ee-8ce1-1bf53cd148d5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:37.164117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:37.172740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 461/937] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:47:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:37.265330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d27b7-120f-4f69-b2c1-60f4f4ccef0c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:37.313426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:37.314075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.314352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.314623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.323092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:37.324574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:37.337931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:37.338948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:37.340176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 477/938] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:47:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:37.347758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec30660-396c-44ee-8ce1-1bf53cd148d5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:37.351776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:37.463934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec30660-396c-44ee-8ce1-1bf53cd148d5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:37.500782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:37.501807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.502331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.502811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.503727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:37.504225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:37.505965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:37.524675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 462/939] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 10 11:47:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:37.533124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:37.618790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:37.640887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f046ba-2dc0-46b3-bf7d-5557b117d866 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:37.678118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:37.679105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.679643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.680142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.698844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:37.701115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:37.717342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:37.718303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:37.719783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:37.719783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:37.719783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:37.722057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 478/940] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:37.729981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:37.791766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:37.840527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e2ca6-8584-4785-b3cf-873770d94bd9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:37.874347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:37.875506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:37.875788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:37.876061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:37.876692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:37.877012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:37.878373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:37.889668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 463/941] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:37.895197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.004194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b2f43-3e97-4e24-b0c0-5a87b3378bf9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.036286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:38.041638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118fdac-40c9-4d5b-a205-23c6fb357c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.042276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fdac-40c9-4d5b-a205-23c6fb357c35 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.042560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fdac-40c9-4d5b-a205-23c6fb357c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.042823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fdac-40c9-4d5b-a205-23c6fb357c35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.054264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118fdac-40c9-4d5b-a205-23c6fb357c35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.056011 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118fdac-40c9-4d5b-a205-23c6fb357c35 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f118fdac-40c9-4d5b-a205-23c6fb357c35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:38.067573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:38.068526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:38.069508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:38.069508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:38.069508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:38.069508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:38.069508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:38.069508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:38.069508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:38.069508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:38.071938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 479/942] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:38.077407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.129714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a914-e953-4544-973b-6c8a07901626 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.130356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a914-e953-4544-973b-6c8a07901626 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.130839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a914-e953-4544-973b-6c8a07901626 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.132326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 480/943] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:38.138911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d246e4-2f40-4154-ad22-8b7cb4f265e3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.139610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d246e4-2f40-4154-ad22-8b7cb4f265e3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.141037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d246e4-2f40-4154-ad22-8b7cb4f265e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.165839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-45d246e4-2f40-4154-ad22-8b7cb4f265e3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:38.167934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-45d246e4-2f40-4154-ad22-8b7cb4f265e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:38.187950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc405-56b0-406f-83dc-92c6a4609d21 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.210264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:38.228816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.229565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.229921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.230270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.231026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:38.231408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.233409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.247659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 464/944] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:38.256072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.261809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 481/945] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:38.354973 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c0570-24df-4f81-85d7-ab6f605af74a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.389632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7795b23-ca5b-4c8e-a10f-1f04f0c99976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.390545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7795b23-ca5b-4c8e-a10f-1f04f0c99976 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.390967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7795b23-ca5b-4c8e-a10f-1f04f0c99976 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.391378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7795b23-ca5b-4c8e-a10f-1f04f0c99976 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/31d1decf1f0a47e3bfdb8f7cc8d3d98c/roles/9a3be5b2c3364fe9b2da8b1c5fc0ed70` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.393740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7795b23-ca5b-4c8e-a10f-1f04f0c99976 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=31d1decf1f0a47e3bfdb8f7cc8d3d98c, role_id=9a3be5b2c3364fe9b2da8b1c5fc0ed70)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.395299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7795b23-ca5b-4c8e-a10f-1f04f0c99976 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.409759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 465/946] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:38 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/31d1decf1f0a47e3bfdb8f7cc8d3d98c/roles/9a3be5b2c3364fe9b2da8b1c5fc0ed70 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:47:38.547125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d246e4-2f40-4154-ad22-8b7cb4f265e3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.652281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d246e4-2f40-4154-ad22-8b7cb4f265e3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.675976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:38.689960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.690644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.690928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.691198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.691781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.693170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:38.702218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:38.703751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:38.704658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 482/947] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:38.712586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7795b23-ca5b-4c8e-a10f-1f04f0c99976 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.756213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:38.819707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7795b23-ca5b-4c8e-a10f-1f04f0c99976 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:38.854742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:38.855351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:38.855627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:38.855894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:38.856513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:38.856807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:38.858193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:38.864004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 466/948] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:38.869645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:38.977845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136878d-97b8-4391-85fc-c4b0f5415bc7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.018736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cd622-270d-46da-92fe-e414a8104666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.019783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cd622-270d-46da-92fe-e414a8104666 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.020289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cd622-270d-46da-92fe-e414a8104666 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.020767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cd622-270d-46da-92fe-e414a8104666 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.021635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cd622-270d-46da-92fe-e414a8104666 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:39.022166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cd622-270d-46da-92fe-e414a8104666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.023754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cd622-270d-46da-92fe-e414a8104666 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.029769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 483/949] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:39.036146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.132382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d950a5-5efa-463b-ac44-104ffb411f90 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.132577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d950a5-5efa-463b-ac44-104ffb411f90 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.132842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d950a5-5efa-463b-ac44-104ffb411f90 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.134334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 484/950] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:39.141252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227331c-7af5-4586-928e-c95fb723e8ce None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.141534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227331c-7af5-4586-928e-c95fb723e8ce None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.141799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f39b57-c886-4d77-8a27-341d93678019 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.141929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227331c-7af5-4586-928e-c95fb723e8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.144673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:39.164583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4227331c-7af5-4586-928e-c95fb723e8ce None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:39.165798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4227331c-7af5-4586-928e-c95fb723e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:39.181109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c80a83-1da2-4f3f-9747-bb62ae0ebbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.182084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80a83-1da2-4f3f-9747-bb62ae0ebbf0 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.182578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80a83-1da2-4f3f-9747-bb62ae0ebbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.183279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80a83-1da2-4f3f-9747-bb62ae0ebbf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.184614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c80a83-1da2-4f3f-9747-bb62ae0ebbf0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.186506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c80a83-1da2-4f3f-9747-bb62ae0ebbf0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.215411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 467/951] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:47:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:47:39.245708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:39.255996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 485/952] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:39.438512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca5ffe-7a7a-4c7b-ad31-9fd91a1c1121 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.438718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca5ffe-7a7a-4c7b-ad31-9fd91a1c1121 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.438997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca5ffe-7a7a-4c7b-ad31-9fd91a1c1121 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.440326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 468/953] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:39.445719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106d0f-24e4-44dd-bd47-89f6cbb45d97 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.446005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106d0f-24e4-44dd-bd47-89f6cbb45d97 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.446277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106d0f-24e4-44dd-bd47-89f6cbb45d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.471213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ab106d0f-24e4-44dd-bd47-89f6cbb45d97 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:39.472745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ab106d0f-24e4-44dd-bd47-89f6cbb45d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:39.538826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca5ffe-7a7a-4c7b-ad31-9fd91a1c1121 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.544102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 486/954] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:39.644195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca5ffe-7a7a-4c7b-ad31-9fd91a1c1121 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.683809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.684421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.684703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.684994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.685648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.687102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.689793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING keystone.server.flask.common [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 10 11:47:39.708200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.sql.core [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 11:47:39.708200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 11:47:39.708200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [parameters: {'id': '20cdbb74911c4dbc82fe51974bdf8f18', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 10 11:47:39.708200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81409) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20cdbb74911c4dbc82fe51974bdf8f18.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20cdbb74911c4dbc82fe51974bdf8f18. Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:47:39.715962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result.read() Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 10 11:47:39.716772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application yield resource Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise self.value Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application session.commit() Oct 10 11:47:39.717772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.session.flush() Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application compat.raise_( Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 11:47:39.719999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 11:47:39.722146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result.read() Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:47:39.724030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [parameters: {'id': '20cdbb74911c4dbc82fe51974bdf8f18', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.725989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:39.727974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 20cdbb74911c4dbc82fe51974bdf8f18. Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:39.730256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 469/955] 10.222.0.45 () {60 vars in 1140 bytes} [Mon Oct 10 11:47:39 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:39.731699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106d0f-24e4-44dd-bd47-89f6cbb45d97 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.841607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106d0f-24e4-44dd-bd47-89f6cbb45d97 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:39.849315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.854421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:39.877496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:39.884193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:39.884806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:39.885111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:39.885385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:39.892219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:39.893913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:39.905190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:39.906675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:39.907606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 487/956] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:39.913779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:39.978620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10395e37-88f7-411a-91a7-832c4e1f8a96 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:40.028664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:40.029326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.029609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.029879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.030481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:40.032117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:40.036145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ff6cd-dae5-4a41-8426-823a57fc6509 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:40.044433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:40.045714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:40.047158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:40.050776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 470/957] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:40.056110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:40.079549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:40.080212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.080499 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.080770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.081711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:40.081823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:40.083300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:40.109466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 488/958] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:40.166252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:40.190842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32503340-8627-4e08-b3e2-da7a65f4cd48 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:40.227587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bc46f-f037-40af-838f-f565be97535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:40.228206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc46f-f037-40af-838f-f565be97535d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.228480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc46f-f037-40af-838f-f565be97535d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.228805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc46f-f037-40af-838f-f565be97535d None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.229530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bc46f-f037-40af-838f-f565be97535d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:40.229834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bc46f-f037-40af-838f-f565be97535d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:40.231213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bc46f-f037-40af-838f-f565be97535d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:40.240395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 471/959] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:40.246031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:40.279993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:40.362819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be70ece-b158-4c40-990d-c4ae0629d3aa None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:40.398653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415473e1-7f16-4408-a431-53822fe7c77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:40.399627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415473e1-7f16-4408-a431-53822fe7c77c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.400110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415473e1-7f16-4408-a431-53822fe7c77c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.400595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415473e1-7f16-4408-a431-53822fe7c77c None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.401476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415473e1-7f16-4408-a431-53822fe7c77c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:40.401982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415473e1-7f16-4408-a431-53822fe7c77c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:40.403567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415473e1-7f16-4408-a431-53822fe7c77c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:40.409367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 489/960] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:40.713362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eff3b-b6df-47fa-88ed-3615d075fd8c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.713765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eff3b-b6df-47fa-88ed-3615d075fd8c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.713961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eff3b-b6df-47fa-88ed-3615d075fd8c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.715464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 472/961] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:40.721494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099eb8-ce3a-442a-8df5-317dcd5af462 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:40.721781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099eb8-ce3a-442a-8df5-317dcd5af462 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:40.722057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099eb8-ce3a-442a-8df5-317dcd5af462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:40.740009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-18099eb8-ce3a-442a-8df5-317dcd5af462 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:40.741213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-18099eb8-ce3a-442a-8df5-317dcd5af462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:40.809968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 490/962] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:41.085831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eff3b-b6df-47fa-88ed-3615d075fd8c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:41.197627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eff3b-b6df-47fa-88ed-3615d075fd8c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:41.232794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c61545-3dc1-45c1-86e1-7bc354490f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:41.233781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c61545-3dc1-45c1-86e1-7bc354490f0c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.234824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c61545-3dc1-45c1-86e1-7bc354490f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.235332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c61545-3dc1-45c1-86e1-7bc354490f0c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.245994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c61545-3dc1-45c1-86e1-7bc354490f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d3c61545-3dc1-45c1-86e1-7bc354490f0c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:41.251327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:41.252270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:41.253533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:41.255960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 473/963] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 10 11:47:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:41.261995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18099eb8-ce3a-442a-8df5-317dcd5af462 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:41.285760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:41.371573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18099eb8-ce3a-442a-8df5-317dcd5af462 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:41.407941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc8db9-fc1b-443e-a1c6-0037b0d389ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:41.408546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8db9-fc1b-443e-a1c6-0037b0d389ca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.408825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8db9-fc1b-443e-a1c6-0037b0d389ca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.409120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8db9-fc1b-443e-a1c6-0037b0d389ca None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.409772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc8db9-fc1b-443e-a1c6-0037b0d389ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:41.410071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc8db9-fc1b-443e-a1c6-0037b0d389ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:41.411513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc8db9-fc1b-443e-a1c6-0037b0d389ca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:41.419994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 491/964] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 10 11:47:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:41.426066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c61545-3dc1-45c1-86e1-7bc354490f0c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:41.430651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:41.461702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90430c27-9542-4644-b29c-87d0dcf7adbe None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.461915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90430c27-9542-4644-b29c-87d0dcf7adbe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.462146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90430c27-9542-4644-b29c-87d0dcf7adbe None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.463618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 492/965] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:41.470542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b856c3c-b9c1-4d41-a819-21e904df8c55 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.471081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b856c3c-b9c1-4d41-a819-21e904df8c55 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.471638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b856c3c-b9c1-4d41-a819-21e904df8c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.494287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4b856c3c-b9c1-4d41-a819-21e904df8c55 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:41.496352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4b856c3c-b9c1-4d41-a819-21e904df8c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:41.545696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c61545-3dc1-45c1-86e1-7bc354490f0c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:41.588998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 493/966] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:41.589214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:41.589214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.589214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.589214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.599598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:41.601136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:41.616145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:41.617175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:41.618566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:41.618566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:41.618566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:41.618566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 474/967] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:41.622996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b856c3c-b9c1-4d41-a819-21e904df8c55 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:41.661348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:41.728493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b856c3c-b9c1-4d41-a819-21e904df8c55 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:41.762463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:41.763188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.763447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.763643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.764285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:41.764590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:41.766516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:41.777789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 494/968] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:41.783927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:41.850201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:41.881649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:41.897373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf282b4-d353-494f-a91e-a1868479a562 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:41.938276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:41.939680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:41.939978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:41.940242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:41.950600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:41.952301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:41.964838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:41.968927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:41.969928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:41.970912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 475/969] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:47:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:41.976709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.004365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9e521-aad6-4959-9933-ab4deb0be011 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.049554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.050200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.050480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.050753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.051605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.053258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:42.065559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:42.066610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:42.067461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 495/970] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:42.072785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.111884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51c1e4-2ba7-4d9a-8d59-adcb61a1753a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.130530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.152257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.153339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.153869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.154350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.155274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:42.156596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.159151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.181946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 476/971] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 10 11:47:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:42.191922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.203065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b5cfa-776f-4f9a-a648-5bd57e0df61d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.240511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.241660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.242232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.242711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.243549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:42.244059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.245783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.247957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.258442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 496/972] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:42.260054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.294826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1cb00-1bbd-4463-9998-06e8315d0391 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.331249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574eed5-e919-4d70-8062-7755ed515306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.331864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574eed5-e919-4d70-8062-7755ed515306 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.332145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574eed5-e919-4d70-8062-7755ed515306 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.332418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574eed5-e919-4d70-8062-7755ed515306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.372588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604248a4-879e-4e8a-8c71-9a91df59e6e5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.380138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.410047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574eed5-e919-4d70-8062-7755ed515306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.411445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574eed5-e919-4d70-8062-7755ed515306 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.418597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.419549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.420132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.420711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.421612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:42.422124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.423966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.434572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 497/973] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:42.436125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.511235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.525344 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 477/974] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:42.526729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fc92-cf94-43b0-8194-0161422269b3 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.527026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fc92-cf94-43b0-8194-0161422269b3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.527302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fc92-cf94-43b0-8194-0161422269b3 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.533477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 478/975] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:42.533477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53fc92-cf94-43b0-8194-0161422269b3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.556736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558350-ff4c-4df1-8460-6c74ed7e410e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.591622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8e0b4-ad15-4012-8f84-c5faf07c1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.592232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8e0b4-ad15-4012-8f84-c5faf07c1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.592507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8e0b4-ad15-4012-8f84-c5faf07c1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.592804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8e0b4-ad15-4012-8f84-c5faf07c1ab0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.593535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8e0b4-ad15-4012-8f84-c5faf07c1ab0 None admin] RBAC: Adding query filter params (interface=admin, service_id=6824a84b86964f73b4d4df42ceebe8c0, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:42.593837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8e0b4-ad15-4012-8f84-c5faf07c1ab0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.595195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8e0b4-ad15-4012-8f84-c5faf07c1ab0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.600300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 498/976] 10.222.0.45 () {56 vars in 1249 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/endpoints?service_id=6824a84b86964f73b4d4df42ceebe8c0&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:42.601575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fa91-59d4-4de6-8cdb-8d0ab068c959 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.601859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fa91-59d4-4de6-8cdb-8d0ab068c959 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.602125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0fa91-59d4-4de6-8cdb-8d0ab068c959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.614722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.619515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6df0fa91-59d4-4de6-8cdb-8d0ab068c959 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:42.620702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6df0fa91-59d4-4de6-8cdb-8d0ab068c959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:42.642051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53fc92-cf94-43b0-8194-0161422269b3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.674920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d077-290e-40b5-bdd0-1dbd3da000cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.675481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d077-290e-40b5-bdd0-1dbd3da000cd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.675759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d077-290e-40b5-bdd0-1dbd3da000cd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.676027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d077-290e-40b5-bdd0-1dbd3da000cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.685622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d077-290e-40b5-bdd0-1dbd3da000cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.687585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d077-290e-40b5-bdd0-1dbd3da000cd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.688126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 499/977] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:42.689416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993e65a-7bfe-4e43-bac3-bea8337024e4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.689702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993e65a-7bfe-4e43-bac3-bea8337024e4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.689972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993e65a-7bfe-4e43-bac3-bea8337024e4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.691172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 500/978] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:42.691847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993e65a-7bfe-4e43-bac3-bea8337024e4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-7a44d077-290e-40b5-bdd0-1dbd3da000cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:42.710933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:42.711925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:42.712867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:42.712867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:42.712867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:42.712867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 479/979] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:42.713586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdd379-1e03-4b3b-9349-b169ef5f0ee6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.713867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdd379-1e03-4b3b-9349-b169ef5f0ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.714142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdd379-1e03-4b3b-9349-b169ef5f0ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.732992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-00cdd379-1e03-4b3b-9349-b169ef5f0ee6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:42.734558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-00cdd379-1e03-4b3b-9349-b169ef5f0ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:42.768935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.803865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 480/980] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:42.805083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdd379-1e03-4b3b-9349-b169ef5f0ee6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.830573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993e65a-7bfe-4e43-bac3-bea8337024e4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.863281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:42.876362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916de7-ff6a-4fc6-81d8-c4a82678a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.876996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916de7-ff6a-4fc6-81d8-c4a82678a511 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.877409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916de7-ff6a-4fc6-81d8-c4a82678a511 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.877820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916de7-ff6a-4fc6-81d8-c4a82678a511 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.878435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c916de7-ff6a-4fc6-81d8-c4a82678a511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.880718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c916de7-ff6a-4fc6-81d8-c4a82678a511 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.887901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 501/981] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:47:42.915376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdd379-1e03-4b3b-9349-b169ef5f0ee6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:42.954310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:42.954863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:42.955151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:42.955431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:42.956090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:42.956401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:42.957827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:42.964346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916de7-ff6a-4fc6-81d8-c4a82678a511 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:42.977950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 481/982] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:42.983228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.086984 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916de7-ff6a-4fc6-81d8-c4a82678a511 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.112285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.114381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0970f-2ceb-4c33-8f6a-b595121d2657 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.126077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.126905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.127289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.127462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.128099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.129567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.132134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING keystone.server.flask.common [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 10 11:47:43.132248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.145174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.sql.core [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 11:47:43.145174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 10 11:47:43.145174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [parameters: {'user_id': 'ec56ceacf35046328d1d58b7118f3c44', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 10 11:47:43.145174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 10 11:47:43.151834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.152469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.152753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.153054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.159994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Oct 10 11:47:43.160997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:47:43.161904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application yield resource Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.rollback() Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.force_reraise() Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise self.value Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application session.commit() Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 10 11:47:43.163616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._prepare_impl() Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.flush() Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._flush(objects) Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application compat.raise_( Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application flush_context.execute() Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rec.execute(self) Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 11:47:43.164513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 11:47:43.166377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 11:47:43.169025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ec56ceacf35046328d1d58b7118f3c44', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:43.172106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 10 11:47:43.174292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 10 11:47:43.176745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 10 11:47:43.176745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 10 11:47:43.176745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 10 11:47:43.176745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 10 11:47:43.176745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 10 11:47:43.176745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:43.177656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.177802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 502/983] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 10 11:47:42 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:43.177802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:43.179708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:43.181753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:43.184106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:43.184106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:43.184106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:43.184106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:43.184106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:43.184106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:43.184106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:43.184106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:43.185927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 482/984] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:43.186166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.274040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb395c7-369c-4a18-93de-e3c5b0a6c686 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.294920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3d695-d985-407a-a1af-471ab9199357 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.310512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5157d-b01a-42b9-ac22-a2346b149899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.311123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5157d-b01a-42b9-ac22-a2346b149899 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.311509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5157d-b01a-42b9-ac22-a2346b149899 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.311802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5157d-b01a-42b9-ac22-a2346b149899 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.313169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5157d-b01a-42b9-ac22-a2346b149899 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.314809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5157d-b01a-42b9-ac22-a2346b149899 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.330242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.330909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.331195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.331468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.337108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 503/985] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:47:43 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:43.337108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5157d-b01a-42b9-ac22-a2346b149899 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.347692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.349244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:43.362570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:43.363770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 10 11:47:43.364873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:43.368750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 483/986] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:43.369851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.411889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.415033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.489580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5157d-b01a-42b9-ac22-a2346b149899 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.495741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252c713-8751-40c5-9113-28e6f1dfd049 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.534343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.535761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.535761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.535761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.536071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:43.536367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.538878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb944d-7b7d-4718-8c8a-43ef42141adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.538878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb944d-7b7d-4718-8c8a-43ef42141adb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.539107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.539195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb944d-7b7d-4718-8c8a-43ef42141adb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.539195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb944d-7b7d-4718-8c8a-43ef42141adb None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.539548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb944d-7b7d-4718-8c8a-43ef42141adb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:43.539948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb944d-7b7d-4718-8c8a-43ef42141adb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.542640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb944d-7b7d-4718-8c8a-43ef42141adb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.553139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 504/987] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:43.558864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:43.583131 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 484/988] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:43.677405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:43.681360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a92d-d503-44d9-a07e-47a250e557ed None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:43.727808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a738864-bf52-4593-b001-3424d23ed8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:43.728533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a738864-bf52-4593-b001-3424d23ed8da None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:43.728887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a738864-bf52-4593-b001-3424d23ed8da None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:43.729262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a738864-bf52-4593-b001-3424d23ed8da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:43.730138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a738864-bf52-4593-b001-3424d23ed8da None admin] RBAC: Adding query filter params (role.id=9a3be5b2c3364fe9b2da8b1c5fc0ed70, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=31d1decf1f0a47e3bfdb8f7cc8d3d98c) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:43.730454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a738864-bf52-4593-b001-3424d23ed8da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:43.731950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a738864-bf52-4593-b001-3424d23ed8da None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:43.739429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 505/989] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:43 2022] GET /identity/v3/role_assignments?user.id=31d1decf1f0a47e3bfdb8f7cc8d3d98c&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=9a3be5b2c3364fe9b2da8b1c5fc0ed70 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:45.091913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1c7f-46be-43cf-b4c9-aaaf33841973 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.092403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1c7f-46be-43cf-b4c9-aaaf33841973 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.092403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1c7f-46be-43cf-b4c9-aaaf33841973 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.094411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 485/990] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:45.099480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fda21-5712-4a2e-920c-b735099c0d9d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.099860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fda21-5712-4a2e-920c-b735099c0d9d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.100035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fda21-5712-4a2e-920c-b735099c0d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.118886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fc5fda21-5712-4a2e-920c-b735099c0d9d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:45.120385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fc5fda21-5712-4a2e-920c-b735099c0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:45.193062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 506/991] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:45.455622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc1c7f-46be-43cf-b4c9-aaaf33841973 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.555440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.564697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc1c7f-46be-43cf-b4c9-aaaf33841973 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.598948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.599671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.600072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.600408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.601093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.602513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.605355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda93b-ab52-4860-8754-868cbca5047a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.605647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda93b-ab52-4860-8754-868cbca5047a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.605927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda93b-ab52-4860-8754-868cbca5047a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.607388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 507/992] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:45.612409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:45.613609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 10 11:47:45.614651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:45.615449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929f29-be0c-4e8a-a544-b9f5ffa6d6e5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.615449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929f29-be0c-4e8a-a544-b9f5ffa6d6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.615449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35929f29-be0c-4e8a-a544-b9f5ffa6d6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.617257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 486/993] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:45.620566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.632031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-35929f29-be0c-4e8a-a544-b9f5ffa6d6e5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:45.633239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-35929f29-be0c-4e8a-a544-b9f5ffa6d6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:45.711030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 508/994] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:45.727629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458fed-02ca-4274-b3a1-65834d3b96a2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.762356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374c9dc-234c-4a93-b4a9-92a594cf0706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.762963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c9dc-234c-4a93-b4a9-92a594cf0706 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.763244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c9dc-234c-4a93-b4a9-92a594cf0706 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.763517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c9dc-234c-4a93-b4a9-92a594cf0706 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.764137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c9dc-234c-4a93-b4a9-92a594cf0706 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:45.764436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c9dc-234c-4a93-b4a9-92a594cf0706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.765852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c9dc-234c-4a93-b4a9-92a594cf0706 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.775298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 487/995] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:45.776639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35929f29-be0c-4e8a-a544-b9f5ffa6d6e5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.807054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:45.890643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35929f29-be0c-4e8a-a544-b9f5ffa6d6e5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:45.925120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:45.925735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.926021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.926231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adccce-ad57-4216-870d-0b3da0c46d37 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.926335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.926520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adccce-ad57-4216-870d-0b3da0c46d37 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.926795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adccce-ad57-4216-870d-0b3da0c46d37 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.926968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:45.927213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:45.928251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 488/996] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:45.928582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:45.932983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5538-c06e-4bdb-8f35-6dce5e1ac1a1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:45.933294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5538-c06e-4bdb-8f35-6dce5e1ac1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:45.933570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5538-c06e-4bdb-8f35-6dce5e1ac1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:45.937196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 509/997] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 10 11:47:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:45.939176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:45.952120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e62b5538-c06e-4bdb-8f35-6dce5e1ac1a1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:45.953875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e62b5538-c06e-4bdb-8f35-6dce5e1ac1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:45.972027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.024015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 489/998] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:46.024857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b5538-c06e-4bdb-8f35-6dce5e1ac1a1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.029194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.045569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d884-2a60-44c5-b0f6-2e2e6528cb2d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.079284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b512cb-76ef-4d80-a3b0-bfa9e867af63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.079894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b512cb-76ef-4d80-a3b0-bfa9e867af63 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.080175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b512cb-76ef-4d80-a3b0-bfa9e867af63 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.080450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b512cb-76ef-4d80-a3b0-bfa9e867af63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.081145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b512cb-76ef-4d80-a3b0-bfa9e867af63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.082505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b512cb-76ef-4d80-a3b0-bfa9e867af63 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.098125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 510/999] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:47:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:47:46.135396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b5538-c06e-4bdb-8f35-6dce5e1ac1a1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.182321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.182974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.183255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.183532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.184121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.185557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:46.195295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:46.196368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:46.197970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:46.199124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 490/1000] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:46.203209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b512cb-76ef-4d80-a3b0-bfa9e867af63 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.291562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.309487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.317250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b512cb-76ef-4d80-a3b0-bfa9e867af63 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.354626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.355232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.355505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.355773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.356399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:46.356710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.358136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.365181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 511/1001] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:46.368651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.388018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.406969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e8d4a-a35f-458f-8532-e947cd0c0273 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.442276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.442918 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.443198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.443476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] PATH_INFO: `/v3/services/image` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.444062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.445464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:46.455467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:46.456482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:46.457429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 491/1002] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:46.462447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.482976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bac8-1f43-479a-a1cf-a89788b52416 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.519405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.520008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.520286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.520553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.521209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:46.521508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.522859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.527791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 512/1003] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:46.533935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.548720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.576692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b773d-67e4-4e2d-ab8c-ec358719a163 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.615098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.615714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.616005 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.616275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.616626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:46.617593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] RBAC: Adding query filter params (name=image) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:46.617911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.619417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.625535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 492/1004] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:46.630839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.642521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612aed-9c09-4b43-9136-3d161558a5fc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.677595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.678220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.678495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.678763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.679461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] RBAC: Adding query filter params (interface=public, service_id=7c0ecdcf76a24d2899bebd2561703f3f, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:46.679792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.681169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.687590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 513/1005] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/endpoints?service_id=7c0ecdcf76a24d2899bebd2561703f3f&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:46.692756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:46.741695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693250a2-33ad-4150-86bb-a939718a5495 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.780311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409dad8-cee4-4215-a25a-e72cbe0a1a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.780958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409dad8-cee4-4215-a25a-e72cbe0a1a5b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.781264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409dad8-cee4-4215-a25a-e72cbe0a1a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.781539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409dad8-cee4-4215-a25a-e72cbe0a1a5b None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.782158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409dad8-cee4-4215-a25a-e72cbe0a1a5b None admin] RBAC: Adding query filter params (type=image) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:46.782459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409dad8-cee4-4215-a25a-e72cbe0a1a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.783815 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409dad8-cee4-4215-a25a-e72cbe0a1a5b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.788382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 493/1006] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:46.801010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e62fb7-6234-4aaf-a1a7-ff9bcc322f5f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:46.843633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c9af9-9e79-4d2b-ad82-c21947aab02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:46.844370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c9af9-9e79-4d2b-ad82-c21947aab02b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:46.844720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c9af9-9e79-4d2b-ad82-c21947aab02b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:46.845095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c9af9-9e79-4d2b-ad82-c21947aab02b None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:46.845790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c9af9-9e79-4d2b-ad82-c21947aab02b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:46.847282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c9af9-9e79-4d2b-ad82-c21947aab02b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:46.854776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 514/1007] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:47:46 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 11:47:48.301381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713daaa-7e08-454c-b553-491844d57049 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.301985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713daaa-7e08-454c-b553-491844d57049 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.301985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713daaa-7e08-454c-b553-491844d57049 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.303463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 494/1008] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:48.308592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079c60-c49f-4bac-9532-3cdd976aba6e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.308967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079c60-c49f-4bac-9532-3cdd976aba6e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.309179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce079c60-c49f-4bac-9532-3cdd976aba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.317281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:48.328948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ce079c60-c49f-4bac-9532-3cdd976aba6e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:48.330140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ce079c60-c49f-4bac-9532-3cdd976aba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:48.397388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 515/1009] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:48.660926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713daaa-7e08-454c-b553-491844d57049 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:48.664741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:48.765356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713daaa-7e08-454c-b553-491844d57049 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:48.798073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b75984-88cb-4968-bcc0-79009a5bc1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:48.798701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75984-88cb-4968-bcc0-79009a5bc1cc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.798981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75984-88cb-4968-bcc0-79009a5bc1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.799252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75984-88cb-4968-bcc0-79009a5bc1cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.800358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b75984-88cb-4968-bcc0-79009a5bc1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:48.801803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b75984-88cb-4968-bcc0-79009a5bc1cc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:48.810700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 495/1010] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:48.812507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce079c60-c49f-4bac-9532-3cdd976aba6e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:48.919641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce079c60-c49f-4bac-9532-3cdd976aba6e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:48.937862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57496a91-ce4e-424b-a266-88fa2c113228 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.938180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57496a91-ce4e-424b-a266-88fa2c113228 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.938418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57496a91-ce4e-424b-a266-88fa2c113228 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.939888 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 496/1011] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:48.944810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7033f-27f7-4f58-aa68-5b525bbc02f7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.945116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7033f-27f7-4f58-aa68-5b525bbc02f7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.945394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7033f-27f7-4f58-aa68-5b525bbc02f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.958595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628af4d-1712-4ecb-98a3-2bbdd857c47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:48.959237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628af4d-1712-4ecb-98a3-2bbdd857c47c None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:48.959499 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628af4d-1712-4ecb-98a3-2bbdd857c47c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:48.959768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628af4d-1712-4ecb-98a3-2bbdd857c47c None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:48.960413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628af4d-1712-4ecb-98a3-2bbdd857c47c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:48.961884 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628af4d-1712-4ecb-98a3-2bbdd857c47c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:48.963276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d2c7033f-27f7-4f58-aa68-5b525bbc02f7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:48.964454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d2c7033f-27f7-4f58-aa68-5b525bbc02f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:48.966663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:48.995166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 516/1012] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:47:48 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:49.030388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd951862-bd60-48f2-a92f-e1914ff1e700 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.030680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd951862-bd60-48f2-a92f-e1914ff1e700 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.030958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd951862-bd60-48f2-a92f-e1914ff1e700 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.032339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 517/1013] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:49.038123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89280bab-c8ea-4404-99c6-177971ea03b5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.038406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89280bab-c8ea-4404-99c6-177971ea03b5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.038684 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89280bab-c8ea-4404-99c6-177971ea03b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.056527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 497/1014] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:49.058375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-89280bab-c8ea-4404-99c6-177971ea03b5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:49.059626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-89280bab-c8ea-4404-99c6-177971ea03b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:49.136222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 518/1015] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:49.315581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7033f-27f7-4f58-aa68-5b525bbc02f7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.317755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:49.402403 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89280bab-c8ea-4404-99c6-177971ea03b5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.416243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7033f-27f7-4f58-aa68-5b525bbc02f7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.452254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf5a6-11d4-4cf1-97d1-73fc904410b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:49.452863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf5a6-11d4-4cf1-97d1-73fc904410b8 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.453178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf5a6-11d4-4cf1-97d1-73fc904410b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.453450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbf5a6-11d4-4cf1-97d1-73fc904410b8 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.454094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbf5a6-11d4-4cf1-97d1-73fc904410b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:49.455448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbf5a6-11d4-4cf1-97d1-73fc904410b8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:49.477026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 498/1016] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:47:49 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:47:49.515679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89280bab-c8ea-4404-99c6-177971ea03b5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.534627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:49.564408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:49.565083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.565364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.565695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.566226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:49.567634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:49.577339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:49.578445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 10 11:47:49.579334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:49.581314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 519/1017] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:49.584486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf5a6-11d4-4cf1-97d1-73fc904410b8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.653741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:49.696655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbf5a6-11d4-4cf1-97d1-73fc904410b8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.736639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:49.737283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.737569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.737845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.738479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:49.738783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:49.740145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:49.745418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 499/1018] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:49.751544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:49.862375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a16bb-8192-46e5-b285-cf0cce7702c6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:49.896837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24c16-853f-4770-bc7d-d8a913387339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:49.897480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24c16-853f-4770-bc7d-d8a913387339 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:49.897760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24c16-853f-4770-bc7d-d8a913387339 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:49.898031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24c16-853f-4770-bc7d-d8a913387339 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:49.898689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24c16-853f-4770-bc7d-d8a913387339 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:49.898990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24c16-853f-4770-bc7d-d8a913387339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:49.900365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24c16-853f-4770-bc7d-d8a913387339 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:49.910580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 520/1019] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 10 11:47:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:49.911849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:50.014395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94e1af-e23a-4e0c-ac21-f20039ff68fd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:50.038724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:50.048692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42594a45-2449-43e3-87cc-5b317b2259a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:50.049336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42594a45-2449-43e3-87cc-5b317b2259a2 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:50.049617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42594a45-2449-43e3-87cc-5b317b2259a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:50.049888 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42594a45-2449-43e3-87cc-5b317b2259a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:50.050556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42594a45-2449-43e3-87cc-5b317b2259a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:50.051902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42594a45-2449-43e3-87cc-5b317b2259a2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:50.076997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 500/1020] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:47:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:47:51.163950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b8ac-dee7-4c92-8aee-956e965cd170 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.164441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b8ac-dee7-4c92-8aee-956e965cd170 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.164441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60b8ac-dee7-4c92-8aee-956e965cd170 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.165914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 521/1021] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:51.171444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0695-1ac1-4f4f-b349-540028f9fda1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.171821 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0695-1ac1-4f4f-b349-540028f9fda1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.171998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0695-1ac1-4f4f-b349-540028f9fda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.190424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-701e0695-1ac1-4f4f-b349-540028f9fda1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:51.191597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-701e0695-1ac1-4f4f-b349-540028f9fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:51.264699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 501/1022] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:51.532995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b8ac-dee7-4c92-8aee-956e965cd170 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:51.580077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:51.640074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60b8ac-dee7-4c92-8aee-956e965cd170 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:51.657082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff07ee0-c728-4ad7-bcc8-5b2f8073b33f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.657389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff07ee0-c728-4ad7-bcc8-5b2f8073b33f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.657672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff07ee0-c728-4ad7-bcc8-5b2f8073b33f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.659004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 502/1023] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:51.664133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e184a0-5d07-4c47-a938-3d5ec88ca1ff None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.664421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e184a0-5d07-4c47-a938-3d5ec88ca1ff None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.664699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e184a0-5d07-4c47-a938-3d5ec88ca1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.676503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054befaf-1d1e-4303-9996-df5ac1a06b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:51.677161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054befaf-1d1e-4303-9996-df5ac1a06b7d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.677439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054befaf-1d1e-4303-9996-df5ac1a06b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.677705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054befaf-1d1e-4303-9996-df5ac1a06b7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.678801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054befaf-1d1e-4303-9996-df5ac1a06b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:51.680217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054befaf-1d1e-4303-9996-df5ac1a06b7d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:51.681926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 522/1024] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:51.683132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-55e184a0-5d07-4c47-a938-3d5ec88ca1ff None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:51.684314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-55e184a0-5d07-4c47-a938-3d5ec88ca1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:51.687263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054befaf-1d1e-4303-9996-df5ac1a06b7d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:51.760483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 503/1025] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:51.794484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054befaf-1d1e-4303-9996-df5ac1a06b7d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:51.806176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:51.832219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac088b-116a-4ff9-beac-994a8b506751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:51.832824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac088b-116a-4ff9-beac-994a8b506751 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:51.833130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac088b-116a-4ff9-beac-994a8b506751 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:51.833398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac088b-116a-4ff9-beac-994a8b506751 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:51.834074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac088b-116a-4ff9-beac-994a8b506751 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:51.835567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac088b-116a-4ff9-beac-994a8b506751 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:51.859425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 523/1026] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:47:51 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:47:52.035348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e184a0-5d07-4c47-a938-3d5ec88ca1ff None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.075435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.141144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e184a0-5d07-4c47-a938-3d5ec88ca1ff None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.175514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac8f72-f2df-43b5-a0da-9573d0a03ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.176131 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8f72-f2df-43b5-a0da-9573d0a03ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.176411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8f72-f2df-43b5-a0da-9573d0a03ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.176681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac8f72-f2df-43b5-a0da-9573d0a03ed6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.177285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac8f72-f2df-43b5-a0da-9573d0a03ed6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.178674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac8f72-f2df-43b5-a0da-9573d0a03ed6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f9ac8f72-f2df-43b5-a0da-9573d0a03ed6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:52.187412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:52.188418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:52.189334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 504/1027] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:52.194879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac088b-116a-4ff9-beac-994a8b506751 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.302517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac088b-116a-4ff9-beac-994a8b506751 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.325430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f8014-51c3-4b0b-863b-f9d2c8564de9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.325772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f8014-51c3-4b0b-863b-f9d2c8564de9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.325982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f8014-51c3-4b0b-863b-f9d2c8564de9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.327356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 505/1028] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:52.332430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ae1bb-63d3-4cec-bd97-4d7eda999aab None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.332921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ae1bb-63d3-4cec-bd97-4d7eda999aab None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.333229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ae1bb-63d3-4cec-bd97-4d7eda999aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.337515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.338128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.338412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.338686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.339609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] RBAC: Adding query filter params (name=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:52.339919 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.342352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.353297 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 524/1029] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:52.353451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0a8ae1bb-63d3-4cec-bd97-4d7eda999aab None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:52.353642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0a8ae1bb-63d3-4cec-bd97-4d7eda999aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:52.354227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.384798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.437157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 506/1030] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:52.463147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c29c1-96be-4371-88a7-1f7e34e8bb7b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.497584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.498186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.498462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.498755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.499371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] RBAC: Adding query filter params (type=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:52.499929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.501322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.510988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 525/1031] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:52.512016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ae1bb-63d3-4cec-bd97-4d7eda999aab None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.542863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.612415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ae1bb-63d3-4cec-bd97-4d7eda999aab None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.645508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.646113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.646391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.646657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.647343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] RBAC: Adding query filter params (interface=public, service_id=a7a74040513c48a1a61be7d4ddfdd08f, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:52.647648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.649015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.654191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 507/1032] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/endpoints?service_id=a7a74040513c48a1a61be7d4ddfdd08f&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:52.660073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.703064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:52.758249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.769190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6900215-e112-4f1a-a01d-efe8bc7bed9f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.804324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:52.804919 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528c92-1427-41a6-97da-3474af82f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.805570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528c92-1427-41a6-97da-3474af82f791 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.805846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528c92-1427-41a6-97da-3474af82f791 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.806126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528c92-1427-41a6-97da-3474af82f791 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.806936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7528c92-1427-41a6-97da-3474af82f791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:52.808463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7528c92-1427-41a6-97da-3474af82f791 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:52.817395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 526/1033] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:47:52.821241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97a96-f1b1-460f-9db9-0b35a15fcbc4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:52.860569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47191cf-3f2e-4948-92ad-07596ef70c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:52.861248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47191cf-3f2e-4948-92ad-07596ef70c7a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:52.861528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47191cf-3f2e-4948-92ad-07596ef70c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:52.861800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47191cf-3f2e-4948-92ad-07596ef70c7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:52.874737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47191cf-3f2e-4948-92ad-07596ef70c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c47191cf-3f2e-4948-92ad-07596ef70c7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:52.879688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:52.880709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:52.886124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 508/1034] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:52.887548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528c92-1427-41a6-97da-3474af82f791 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.001337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528c92-1427-41a6-97da-3474af82f791 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.036480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.037196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.037479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.037750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.038410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:53.038712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.040080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.048314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 527/1035] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 10 11:47:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:53.054200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47191cf-3f2e-4948-92ad-07596ef70c7a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.156298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47191cf-3f2e-4948-92ad-07596ef70c7a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.189467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.190124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.190349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.190622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.201070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.203093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:53.216738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:53.217878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:53.218800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:53.218800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:53.218800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:53.218800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 509/1036] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:53.225012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.244836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.327463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4aefe8-a49c-4646-a01d-3d64249e8d62 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.359874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.360477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.360812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.361109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.361734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:53.362031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.363425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.375900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 528/1037] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:53.381502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.393554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.485240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d3672-d772-49e9-8c3d-7af63e5de06b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.519161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.519793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.520072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.520342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.528127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.529601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:53.540731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:53.541870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:53.542841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 510/1038] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:53.549864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.631240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.654336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35ba6f-9af5-4676-b448-b26d625b37da None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.689376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.690010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.690284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.690555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.691298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:53.691598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.693095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.715983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 529/1039] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:53.717168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:53.783480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:53.828036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e134e3-eff0-437f-ad2e-ffeaef25f709 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:53.861311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e6e47-352b-405c-934c-7bbe05ef22f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:53.861908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6e47-352b-405c-934c-7bbe05ef22f8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:53.862185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6e47-352b-405c-934c-7bbe05ef22f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:53.862453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6e47-352b-405c-934c-7bbe05ef22f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:53.927848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e6e47-352b-405c-934c-7bbe05ef22f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:53.929390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e6e47-352b-405c-934c-7bbe05ef22f8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:53.996373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.038415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 511/1040] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:54.039701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.090971 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253858ad-b7f4-40fb-b161-48eaf7fce635 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.091267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253858ad-b7f4-40fb-b161-48eaf7fce635 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.091532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253858ad-b7f4-40fb-b161-48eaf7fce635 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.093452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 512/1041] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:54.098512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d86a-bcea-4d20-9f76-24d9a6e6dc1e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.098800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d86a-bcea-4d20-9f76-24d9a6e6dc1e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.099103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d86a-bcea-4d20-9f76-24d9a6e6dc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.117595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2d89d86a-bcea-4d20-9f76-24d9a6e6dc1e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:54.118778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2d89d86a-bcea-4d20-9f76-24d9a6e6dc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:54.144553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7893653-6f01-4375-8405-29d62c596bba None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.184776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.185441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.185715 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.185988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.188763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.193230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 513/1042] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:54.200496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.202630 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:54.217106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:54.218663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:54.219612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:54.219612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:54.219612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:54.219612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 530/1043] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:54.224329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d86a-bcea-4d20-9f76-24d9a6e6dc1e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.321124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.325366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d86a-bcea-4d20-9f76-24d9a6e6dc1e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.361380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.361990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.362266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.362533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.363170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:54.363469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.364823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.380887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 514/1044] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:54.381865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.479901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.485900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d5c87-73ae-4c11-ad10-7da83b5581ef None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.520057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.520689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.521004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.521274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.527940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.529426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:54.541193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:54.542284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:54.543237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 531/1045] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:54.548419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.590980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccec80-79a1-48fc-9038-f179d213d3b6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.600912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.633484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7608d-9990-4890-86a0-4ae365b9542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.634141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7608d-9990-4890-86a0-4ae365b9542d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.634425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7608d-9990-4890-86a0-4ae365b9542d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.634700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7608d-9990-4890-86a0-4ae365b9542d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.650454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7608d-9990-4890-86a0-4ae365b9542d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:54.656389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c31acd-6c92-44a9-9f59-8d4571405f8e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-92a7608d-9990-4890-86a0-4ae365b9542d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:54.656636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:54.657772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:54.658656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:54.661285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 515/1046] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:54.663463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7608d-9990-4890-86a0-4ae365b9542d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.683397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.701248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.702518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.702794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.703062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.703752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:54.704056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.705636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.717707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 532/1047] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:54.723563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.777183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7608d-9990-4890-86a0-4ae365b9542d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.820688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.821412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.821693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.821963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.822651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:54.822928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.824284 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.840936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 516/1048] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:54.841210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15aafb-cd89-471f-9ab8-c50b2de0e54c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:54.842694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:54.850966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.879794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401da935-03fe-4f23-a2bc-aaf5ca9ab222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:54.880407 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401da935-03fe-4f23-a2bc-aaf5ca9ab222 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:54.880680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401da935-03fe-4f23-a2bc-aaf5ca9ab222 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:54.880952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401da935-03fe-4f23-a2bc-aaf5ca9ab222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:54.881708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401da935-03fe-4f23-a2bc-aaf5ca9ab222 None admin] RBAC: Adding query filter params (role.id=9a3be5b2c3364fe9b2da8b1c5fc0ed70, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=aa51dcbe21f04f24887beb458edb1dce) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:54.882016 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401da935-03fe-4f23-a2bc-aaf5ca9ab222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:54.883445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401da935-03fe-4f23-a2bc-aaf5ca9ab222 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:54.890220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 533/1049] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/role_assignments?user.id=aa51dcbe21f04f24887beb458edb1dce&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=9a3be5b2c3364fe9b2da8b1c5fc0ed70 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:54.953893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:54.975769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20a060-ce4a-4c04-99b9-6cea1466a41e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.014904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b5db1-6ef0-4ced-9fd7-8d958a0a1704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.015563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b5db1-6ef0-4ced-9fd7-8d958a0a1704 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.015840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b5db1-6ef0-4ced-9fd7-8d958a0a1704 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.016111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b5db1-6ef0-4ced-9fd7-8d958a0a1704 None admin] PATH_INFO: `/v3/users/7af927225b704dec9e311f46ddcd7a1f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.031273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b5db1-6ef0-4ced-9fd7-8d958a0a1704 None admin] RBAC: Authorizing `identity:get_user(user_id=7af927225b704dec9e311f46ddcd7a1f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.032748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b5db1-6ef0-4ced-9fd7-8d958a0a1704 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.034538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 517/1050] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:54 2022] GET /identity/v3/users/7af927225b704dec9e311f46ddcd7a1f => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:55.040189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199be55-82a8-4a9f-ad83-949d3210f969 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.040491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199be55-82a8-4a9f-ad83-949d3210f969 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.040592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b5db1-6ef0-4ced-9fd7-8d958a0a1704 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.040795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199be55-82a8-4a9f-ad83-949d3210f969 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.042259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 534/1051] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:55.048764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f480-cd8d-40f9-9ef1-b187337f1cde None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.049093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f480-cd8d-40f9-9ef1-b187337f1cde None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.049343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f480-cd8d-40f9-9ef1-b187337f1cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.069053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1ad2f480-cd8d-40f9-9ef1-b187337f1cde None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:55.070277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1ad2f480-cd8d-40f9-9ef1-b187337f1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:55.140660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 535/1052] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:55.154783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b5db1-6ef0-4ced-9fd7-8d958a0a1704 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.192063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496392f-dc41-4853-9e69-01dd6bade57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.193072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496392f-dc41-4853-9e69-01dd6bade57a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.193568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496392f-dc41-4853-9e69-01dd6bade57a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.194487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496392f-dc41-4853-9e69-01dd6bade57a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.205192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.270021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496392f-dc41-4853-9e69-01dd6bade57a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.270021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496392f-dc41-4853-9e69-01dd6bade57a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.383619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 518/1053] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 10 11:47:55.384797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f480-cd8d-40f9-9ef1-b187337f1cde None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.409487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496392f-dc41-4853-9e69-01dd6bade57a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.459232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.498681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f480-cd8d-40f9-9ef1-b187337f1cde None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.505214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.533212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496392f-dc41-4853-9e69-01dd6bade57a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.543198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c03c89-0b3c-4350-b756-6eab2f9f68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.544047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03c89-0b3c-4350-b756-6eab2f9f68af None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.544503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03c89-0b3c-4350-b756-6eab2f9f68af None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.544984 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c03c89-0b3c-4350-b756-6eab2f9f68af None admin] PATH_INFO: `/v3/projects/4d390d04876042c88948c9bbb478feba` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.546684 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c03c89-0b3c-4350-b756-6eab2f9f68af None admin] RBAC: Authorizing `identity:get_project(project_id=4d390d04876042c88948c9bbb478feba)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.548130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c03c89-0b3c-4350-b756-6eab2f9f68af None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.550095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 536/1054] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/projects/4d390d04876042c88948c9bbb478feba => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:55.555969 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c03c89-0b3c-4350-b756-6eab2f9f68af None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.571719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.572361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.572641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.572912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] PATH_INFO: `/v3/services/image` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.573529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.574886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:55.583908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:55.585004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:55.585889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 519/1055] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:55.590998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.668472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c03c89-0b3c-4350-b756-6eab2f9f68af None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.706857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.707578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.707859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.708134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.708859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=4d390d04876042c88948c9bbb478feba, user.id=7af927225b704dec9e311f46ddcd7a1f) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:55.709206 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.711479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.712527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b72c-d6d9-44ac-a556-e1326284f055 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.714560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.718687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 537/1056] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/role_assignments?user.id=7af927225b704dec9e311f46ddcd7a1f&scope.project.id=4d390d04876042c88948c9bbb478feba&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:55.759153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.759790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.760147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.760422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.761258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] RBAC: Adding query filter params (name=image) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:55.761741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.763204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.774149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 520/1057] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:55.775248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:55.816307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:55.896337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5d239-b31a-4b2f-8902-62a90caad00c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:55.933012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715f02d-985b-46ce-9319-b42ef04f6e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:55.933556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f02d-985b-46ce-9319-b42ef04f6e11 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:55.933837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f02d-985b-46ce-9319-b42ef04f6e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:55.934108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715f02d-985b-46ce-9319-b42ef04f6e11 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:55.934739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715f02d-985b-46ce-9319-b42ef04f6e11 None admin] RBAC: Adding query filter params (type=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:55.935044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715f02d-985b-46ce-9319-b42ef04f6e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:55.936543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715f02d-985b-46ce-9319-b42ef04f6e11 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:55.941556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 538/1058] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:55.947513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:56.050035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a92f2a-8b82-45f6-acff-0d3ab054ab54 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:56.084270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46bd10-e332-4a0e-84e7-8060c03157ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:56.084879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46bd10-e332-4a0e-84e7-8060c03157ef None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:56.085199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46bd10-e332-4a0e-84e7-8060c03157ef None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:56.085475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46bd10-e332-4a0e-84e7-8060c03157ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:56.086151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46bd10-e332-4a0e-84e7-8060c03157ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:56.087513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46bd10-e332-4a0e-84e7-8060c03157ef None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:56.113482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 521/1059] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:47:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:47:57.125726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d39e-c74a-4036-be3a-3cf8a13d1945 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.126219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d39e-c74a-4036-be3a-3cf8a13d1945 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.126219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d39e-c74a-4036-be3a-3cf8a13d1945 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.127694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 539/1060] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:47:57.132486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c217a-5f00-4280-ac58-35bed8b0a148 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.132862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c217a-5f00-4280-ac58-35bed8b0a148 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.133102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c217a-5f00-4280-ac58-35bed8b0a148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.150844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4d0c217a-5f00-4280-ac58-35bed8b0a148 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:57.152003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4d0c217a-5f00-4280-ac58-35bed8b0a148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:57.168290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.224681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 522/1061] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:47:57.492165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065d39e-c74a-4036-be3a-3cf8a13d1945 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.592119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.596777 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065d39e-c74a-4036-be3a-3cf8a13d1945 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.631639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830d06-c5ea-4757-be37-ff0f0a39ebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.632271 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830d06-c5ea-4757-be37-ff0f0a39ebf7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.632547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830d06-c5ea-4757-be37-ff0f0a39ebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.632813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830d06-c5ea-4757-be37-ff0f0a39ebf7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.644100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb830d06-c5ea-4757-be37-ff0f0a39ebf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-cb830d06-c5ea-4757-be37-ff0f0a39ebf7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:57.648844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:57.649844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:57.650730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 540/1062] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:57.657459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c217a-5f00-4280-ac58-35bed8b0a148 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.764900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c217a-5f00-4280-ac58-35bed8b0a148 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.800156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a5dcf-6ec3-40c6-8ad0-3b6c51af5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.800789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a5dcf-6ec3-40c6-8ad0-3b6c51af5dbc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.801117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a5dcf-6ec3-40c6-8ad0-3b6c51af5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.801489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a5dcf-6ec3-40c6-8ad0-3b6c51af5dbc None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.802176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a5dcf-6ec3-40c6-8ad0-3b6c51af5dbc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:57.802480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a5dcf-6ec3-40c6-8ad0-3b6c51af5dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:57.805043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a5dcf-6ec3-40c6-8ad0-3b6c51af5dbc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.822510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 523/1063] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:57.824028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830d06-c5ea-4757-be37-ff0f0a39ebf7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:57.921341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452149-1a38-416b-b2cb-b550d0486495 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.921633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452149-1a38-416b-b2cb-b550d0486495 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.921905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea452149-1a38-416b-b2cb-b550d0486495 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.923255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 524/1064] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:57.927283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830d06-c5ea-4757-be37-ff0f0a39ebf7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:57.928549 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374a996-5d3e-4bc2-85a9-feb341e7cadc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.929053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374a996-5d3e-4bc2-85a9-feb341e7cadc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.929334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374a996-5d3e-4bc2-85a9-feb341e7cadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.949597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2374a996-5d3e-4bc2-85a9-feb341e7cadc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:57.950768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2374a996-5d3e-4bc2-85a9-feb341e7cadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:57.954533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:57.964352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:57.965287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:57.965805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:57.966207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:57.977552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:57.978991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:57.994849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:58.001868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:58.003012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:58.003012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:58.003012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:58.003012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 541/1065] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:47:58.003012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.017175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.032597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 525/1066] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:58.106140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f871b22-e90e-47e6-bd00-3b7be5cc6351 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.140909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35066d-9bef-4608-94f2-36c889fec71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.141640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35066d-9bef-4608-94f2-36c889fec71e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.141836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35066d-9bef-4608-94f2-36c889fec71e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.142092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35066d-9bef-4608-94f2-36c889fec71e None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.142735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35066d-9bef-4608-94f2-36c889fec71e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:58.143037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35066d-9bef-4608-94f2-36c889fec71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.144400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35066d-9bef-4608-94f2-36c889fec71e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.161104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 542/1067] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:58.162629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374a996-5d3e-4bc2-85a9-feb341e7cadc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.265297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374a996-5d3e-4bc2-85a9-feb341e7cadc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.279234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacfb2-8765-4714-9b49-eb8244b3061b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.279516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacfb2-8765-4714-9b49-eb8244b3061b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.279831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eacfb2-8765-4714-9b49-eb8244b3061b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.281352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 543/1068] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:47:58.285896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29147b03-6b6e-4276-9699-156128b4efd7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.286180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29147b03-6b6e-4276-9699-156128b4efd7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.286455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29147b03-6b6e-4276-9699-156128b4efd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.300503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.301170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.301453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.301725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.304657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-29147b03-6b6e-4276-9699-156128b4efd7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:47:58.305863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-29147b03-6b6e-4276-9699-156128b4efd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:47:58.308834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.310317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.313438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:47:58.323106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:58.324193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 526/1069] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:58.325717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.372414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.378371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 544/1070] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:47:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:47:58.379375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29147b03-6b6e-4276-9699-156128b4efd7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.427007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c505e-2d42-4346-b7bf-e2185a6b171e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.463978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940425b9-33f4-4556-8788-7e90e3b46533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.464607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940425b9-33f4-4556-8788-7e90e3b46533 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.464888 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940425b9-33f4-4556-8788-7e90e3b46533 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.465192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940425b9-33f4-4556-8788-7e90e3b46533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.476583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940425b9-33f4-4556-8788-7e90e3b46533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-940425b9-33f4-4556-8788-7e90e3b46533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:47:58.481381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:58.482411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:58.483915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 527/1071] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:58.489553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940425b9-33f4-4556-8788-7e90e3b46533 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.494688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29147b03-6b6e-4276-9699-156128b4efd7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.531282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.532178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.532669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.533171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.534130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:58.534636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.536287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.555153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.563892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 545/1072] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:58.564899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.603958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940425b9-33f4-4556-8788-7e90e3b46533 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.623635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.641260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.641871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.642149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.642717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.643077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:58.643379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.644799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.653484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 528/1073] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:47:58.654264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.667356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a0f5-5b66-48c5-b712-89160c76ff08 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.702063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.702739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.703022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.703292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.712978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.714464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:58.729201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:58.730341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:58.731436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:58.731436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:58.731436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:58.731436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 546/1074] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:58.731436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.756607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbedb9-b78d-4d81-8628-e00321574283 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.778773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.791531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e0de-2626-43f8-9b78-02c57b6c972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.792083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e0de-2626-43f8-9b78-02c57b6c972e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.792360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e0de-2626-43f8-9b78-02c57b6c972e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.792632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758e0de-2626-43f8-9b78-02c57b6c972e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.834107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067fb53-49f4-4dbf-a44c-3ccb116e1af3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.844838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:58.860160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758e0de-2626-43f8-9b78-02c57b6c972e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.861744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758e0de-2626-43f8-9b78-02c57b6c972e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.868152 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cededf9-5d27-47a3-a05f-d92133abd1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:58.868778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cededf9-5d27-47a3-a05f-d92133abd1fe None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:58.869096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cededf9-5d27-47a3-a05f-d92133abd1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:58.869380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cededf9-5d27-47a3-a05f-d92133abd1fe None admin] PATH_INFO: `/v3/users/7af927225b704dec9e311f46ddcd7a1f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:58.870497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cededf9-5d27-47a3-a05f-d92133abd1fe None admin] RBAC: Authorizing `identity:get_user(user_id=7af927225b704dec9e311f46ddcd7a1f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:58.871913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cededf9-5d27-47a3-a05f-d92133abd1fe None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:58.873536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 547/1075] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/users/7af927225b704dec9e311f46ddcd7a1f => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:58.874541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cededf9-5d27-47a3-a05f-d92133abd1fe None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.963978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 529/1076] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:47:58.964804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e0de-2626-43f8-9b78-02c57b6c972e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:58.972644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cededf9-5d27-47a3-a05f-d92133abd1fe None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:58.989589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.006222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.006826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.007099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.007364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.007995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:59.008290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.009680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.022136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 548/1077] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:59.022752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.060285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.069802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758e0de-2626-43f8-9b78-02c57b6c972e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.104642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a753c53-ceb8-4f66-9ad7-9f2e502b9bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.105299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753c53-ceb8-4f66-9ad7-9f2e502b9bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.105581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753c53-ceb8-4f66-9ad7-9f2e502b9bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.105850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753c53-ceb8-4f66-9ad7-9f2e502b9bb8 None admin] PATH_INFO: `/v3/projects/4d390d04876042c88948c9bbb478feba` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.106955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753c53-ceb8-4f66-9ad7-9f2e502b9bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=4d390d04876042c88948c9bbb478feba)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.108367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753c53-ceb8-4f66-9ad7-9f2e502b9bb8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.110018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 530/1078] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:47:58 2022] GET /identity/v3/projects/4d390d04876042c88948c9bbb478feba => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:59.110018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a753c53-ceb8-4f66-9ad7-9f2e502b9bb8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.121860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4271f5-234e-4605-90fa-529e5ca691c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.155909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.156513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.156789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.157082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.167042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.168464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:47:59.182757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:59.183874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:47:59.184801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:47:59.184801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:47:59.184801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:47:59.184801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 549/1079] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:59.184801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.203241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.213663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a753c53-ceb8-4f66-9ad7-9f2e502b9bb8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.253382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.254028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.254287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.254554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.261327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.262749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:47:59.274156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:47:59.275340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 531/1080] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:47:59.276365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.279154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.290317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb671a-9779-44cf-97da-077bf792587f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.323695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addff17-db8b-4b75-a7fd-7d259e4b77b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.324277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addff17-db8b-4b75-a7fd-7d259e4b77b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.324554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addff17-db8b-4b75-a7fd-7d259e4b77b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.324824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addff17-db8b-4b75-a7fd-7d259e4b77b9 None admin] PATH_INFO: `/v3/projects/4d390d04876042c88948c9bbb478feba/users/7af927225b704dec9e311f46ddcd7a1f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.327283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addff17-db8b-4b75-a7fd-7d259e4b77b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d390d04876042c88948c9bbb478feba, user_id=7af927225b704dec9e311f46ddcd7a1f, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.328703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addff17-db8b-4b75-a7fd-7d259e4b77b9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.342101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 550/1081] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:59 2022] PUT /identity/v3/projects/4d390d04876042c88948c9bbb478feba/users/7af927225b704dec9e311f46ddcd7a1f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:47:59.342883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addff17-db8b-4b75-a7fd-7d259e4b77b9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.380346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42235-87e5-4bd8-8360-5b9f2761d74f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.419035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.419662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.419949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.420756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.421450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:59.421761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.423159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.449009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 532/1082] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:59.457413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addff17-db8b-4b75-a7fd-7d259e4b77b9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.498018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd6c28-15c0-4879-b085-a97810d5113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.499471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6c28-15c0-4879-b085-a97810d5113e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.499751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6c28-15c0-4879-b085-a97810d5113e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.500021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd6c28-15c0-4879-b085-a97810d5113e None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.500739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6c28-15c0-4879-b085-a97810d5113e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:47:59.501083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6c28-15c0-4879-b085-a97810d5113e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.502600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd6c28-15c0-4879-b085-a97810d5113e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.516533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 551/1083] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:47:59.524215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:47:59.538326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:47:59.639978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c5165-e67a-4395-9378-9bd51d66cb1c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:47:59.678037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ef739-9072-4e7a-a4ea-d98445850a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:47:59.678710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef739-9072-4e7a-a4ea-d98445850a57 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:47:59.678990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef739-9072-4e7a-a4ea-d98445850a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:47:59.679262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef739-9072-4e7a-a4ea-d98445850a57 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/aa51dcbe21f04f24887beb458edb1dce/roles/9a3be5b2c3364fe9b2da8b1c5fc0ed70` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:47:59.681460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ef739-9072-4e7a-a4ea-d98445850a57 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=aa51dcbe21f04f24887beb458edb1dce, role_id=9a3be5b2c3364fe9b2da8b1c5fc0ed70)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:47:59.682890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ef739-9072-4e7a-a4ea-d98445850a57 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:47:59.699090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 533/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:47:59 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/aa51dcbe21f04f24887beb458edb1dce/roles/9a3be5b2c3364fe9b2da8b1c5fc0ed70 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:48:01.480986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f421e63-a0a8-4ee9-9b97-a3b7c05d1a2f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.481549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f421e63-a0a8-4ee9-9b97-a3b7c05d1a2f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.481549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f421e63-a0a8-4ee9-9b97-a3b7c05d1a2f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.482888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 552/1085] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:01.487988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc1c3-161f-495a-a880-ed88dd7b73a6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.488406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc1c3-161f-495a-a880-ed88dd7b73a6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.488513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc1c3-161f-495a-a880-ed88dd7b73a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.506819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-483fc1c3-161f-495a-a880-ed88dd7b73a6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:01.507982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-483fc1c3-161f-495a-a880-ed88dd7b73a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:01.568756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:01.573939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 534/1086] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:01.818556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1215bf2-8ada-47dc-9f44-d0da2d6f8c49 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.818921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1215bf2-8ada-47dc-9f44-d0da2d6f8c49 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.819260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1215bf2-8ada-47dc-9f44-d0da2d6f8c49 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.820654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 553/1087] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:01.825799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41beb6-35f6-4f09-a2a8-5e4ebc0b61f4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.826088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41beb6-35f6-4f09-a2a8-5e4ebc0b61f4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.826364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41beb6-35f6-4f09-a2a8-5e4ebc0b61f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.838819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1215bf2-8ada-47dc-9f44-d0da2d6f8c49 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:01.844260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8e41beb6-35f6-4f09-a2a8-5e4ebc0b61f4 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:01.845465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8e41beb6-35f6-4f09-a2a8-5e4ebc0b61f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:01.850633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:01.913070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 535/1088] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:01.941924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1215bf2-8ada-47dc-9f44-d0da2d6f8c49 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:01.973887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aa112-ad5a-4d10-89e3-9ac7b0c56f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:01.974509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aa112-ad5a-4d10-89e3-9ac7b0c56f85 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:01.974790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aa112-ad5a-4d10-89e3-9ac7b0c56f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:01.975059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361aa112-ad5a-4d10-89e3-9ac7b0c56f85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:01.985357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361aa112-ad5a-4d10-89e3-9ac7b0c56f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-361aa112-ad5a-4d10-89e3-9ac7b0c56f85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:01.990073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:01.991173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:48:01.992504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 554/1089] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:01.997050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41beb6-35f6-4f09-a2a8-5e4ebc0b61f4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.092993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41beb6-35f6-4f09-a2a8-5e4ebc0b61f4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.119880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.126385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.126991 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.127270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.127539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.128193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:02.128521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.129926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.137875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 536/1090] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:02.143747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aa112-ad5a-4d10-89e3-9ac7b0c56f85 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.177583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.212113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.243455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361aa112-ad5a-4d10-89e3-9ac7b0c56f85 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.274461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbeada-0dd5-4d2a-91c6-45109bd36862 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.276606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938bbb0-50e4-436f-ba33-695a4133aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.277289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938bbb0-50e4-436f-ba33-695a4133aed7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.277569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938bbb0-50e4-436f-ba33-695a4133aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.277841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938bbb0-50e4-436f-ba33-695a4133aed7 None admin] PATH_INFO: `/v3/users/7af927225b704dec9e311f46ddcd7a1f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.278954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938bbb0-50e4-436f-ba33-695a4133aed7 None admin] RBAC: Authorizing `identity:get_user(user_id=7af927225b704dec9e311f46ddcd7a1f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.280910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938bbb0-50e4-436f-ba33-695a4133aed7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.282505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 555/1091] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/users/7af927225b704dec9e311f46ddcd7a1f => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:02.288399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938bbb0-50e4-436f-ba33-695a4133aed7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.307678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b48a5-268f-4dea-bd50-dc9b63dbd564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.308315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b48a5-268f-4dea-bd50-dc9b63dbd564 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.308575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b48a5-268f-4dea-bd50-dc9b63dbd564 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.308840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b48a5-268f-4dea-bd50-dc9b63dbd564 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.319241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b48a5-268f-4dea-bd50-dc9b63dbd564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-717b48a5-268f-4dea-bd50-dc9b63dbd564 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:02.323915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:02.329092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:02.330143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 537/1092] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:02.330893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b48a5-268f-4dea-bd50-dc9b63dbd564 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.383017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.386637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938bbb0-50e4-436f-ba33-695a4133aed7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.419761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06eb6-3bd0-4859-ae4e-5627fbde046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.420920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06eb6-3bd0-4859-ae4e-5627fbde046c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.421252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06eb6-3bd0-4859-ae4e-5627fbde046c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.421503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc06eb6-3bd0-4859-ae4e-5627fbde046c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.428765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b48a5-268f-4dea-bd50-dc9b63dbd564 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.429173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.462378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.463070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.463367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.463650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.464758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:02.465124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.467527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.478542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 538/1093] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:02.484833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.490882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc06eb6-3bd0-4859-ae4e-5627fbde046c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.492352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc06eb6-3bd0-4859-ae4e-5627fbde046c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.581688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a41ef-fc49-4e29-8dd0-0e04392636ad None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.588424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 556/1094] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 10 11:48:02.594850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06eb6-3bd0-4859-ae4e-5627fbde046c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.595441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.616387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.617042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.617326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.617598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.628033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.629495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.633214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:02.643866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:02.645184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:02.646341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:02.646341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:02.646341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:02.646341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 539/1095] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:02.650602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.692549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc06eb6-3bd0-4859-ae4e-5627fbde046c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.727065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c94502-ad6e-40af-97bd-28ddf8edb261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.727697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94502-ad6e-40af-97bd-28ddf8edb261 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.727976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94502-ad6e-40af-97bd-28ddf8edb261 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.728245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c94502-ad6e-40af-97bd-28ddf8edb261 None admin] PATH_INFO: `/v3/projects/4d390d04876042c88948c9bbb478feba` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.729377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c94502-ad6e-40af-97bd-28ddf8edb261 None admin] RBAC: Authorizing `identity:get_project(project_id=4d390d04876042c88948c9bbb478feba)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.730807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c94502-ad6e-40af-97bd-28ddf8edb261 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.732412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 557/1096] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/projects/4d390d04876042c88948c9bbb478feba => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:02.738475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c94502-ad6e-40af-97bd-28ddf8edb261 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.754558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78192271-db6d-44ec-b817-4a2f7e80f69f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.789314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.789913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.790193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.790463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.791127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:02.791431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.792840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.806169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 540/1097] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:02.810111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:02.837415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.838667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c94502-ad6e-40af-97bd-28ddf8edb261 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.845991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:02.875083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.875680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.875959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.876230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.876943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=4d390d04876042c88948c9bbb478feba, user.id=7af927225b704dec9e311f46ddcd7a1f) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:02.877285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.878714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.884801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 558/1098] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/role_assignments?user.id=7af927225b704dec9e311f46ddcd7a1f&scope.project.id=4d390d04876042c88948c9bbb478feba&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:02.910403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67daae74-ca96-4b61-91d1-12f3823d8705 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:02.946985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:02.947639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:02.947923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:02.948195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:02.956730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:02.958237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:48:02.970875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:02.976949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:02.978093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 541/1099] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:02.978747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.083495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe3a50-b40f-44a3-bcbc-14a30b48b391 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.116428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.117072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.117351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.117622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.118341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:03.118644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.120074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.137655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 559/1100] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 10 11:48:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:03.144026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.226366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.241310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c02959-5190-48ae-a605-4c5c1078f953 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.274218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790abd39-390d-40cd-b829-593b3004af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.274823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790abd39-390d-40cd-b829-593b3004af84 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.275103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790abd39-390d-40cd-b829-593b3004af84 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.275370 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790abd39-390d-40cd-b829-593b3004af84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.340310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790abd39-390d-40cd-b829-593b3004af84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.341788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790abd39-390d-40cd-b829-593b3004af84 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.423123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.438934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 542/1101] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:03.444675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.472242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.541128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418d89f-b03e-4dc0-b4b2-641a4795657e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.574285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.574911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.575190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.575460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.585256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.586692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:03.601414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:03.602366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:48:03.603659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:03.603659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:48:03.603659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:48:03.603659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 560/1102] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:48:03.608697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790abd39-390d-40cd-b829-593b3004af84 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.703394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790abd39-390d-40cd-b829-593b3004af84 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.736542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.737206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.737484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.737754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.738381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:03.738680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.740034 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.751108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 543/1103] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:03.756679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.839454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:03.859966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b2b53-183e-44d8-8810-877bf6f35d29 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:03.892772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:03.893419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:03.893696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:03.893965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:03.900374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:03.901843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:48:03.913394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:03.914451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:48:03.915769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 561/1104] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:03.920943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:03.965559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:04.016843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11f4b-27ca-4927-b1e5-cd755cbe9e22 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.049485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d1a2-3b6b-4201-8c9f-e0c690e2a5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.050076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d1a2-3b6b-4201-8c9f-e0c690e2a5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.050353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d1a2-3b6b-4201-8c9f-e0c690e2a5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.050622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d1a2-3b6b-4201-8c9f-e0c690e2a5a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.051293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d1a2-3b6b-4201-8c9f-e0c690e2a5a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:04.051592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d1a2-3b6b-4201-8c9f-e0c690e2a5a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:04.052999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d1a2-3b6b-4201-8c9f-e0c690e2a5a2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:04.064698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 544/1105] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:04.070733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:04.170483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5307727-1ef8-4469-b0ff-3e57a38f6cb8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:04.202788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250839fb-8330-44b0-b5ef-0d2b74bda3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:04.203394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250839fb-8330-44b0-b5ef-0d2b74bda3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:04.203673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250839fb-8330-44b0-b5ef-0d2b74bda3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:04.203947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250839fb-8330-44b0-b5ef-0d2b74bda3d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:04.204663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250839fb-8330-44b0-b5ef-0d2b74bda3d2 None admin] RBAC: Adding query filter params (role.id=9a3be5b2c3364fe9b2da8b1c5fc0ed70, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=aa51dcbe21f04f24887beb458edb1dce) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:04.204982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250839fb-8330-44b0-b5ef-0d2b74bda3d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:04.206428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250839fb-8330-44b0-b5ef-0d2b74bda3d2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:04.211971 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 562/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:04 2022] GET /identity/v3/role_assignments?user.id=aa51dcbe21f04f24887beb458edb1dce&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=9a3be5b2c3364fe9b2da8b1c5fc0ed70 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:05.036385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece82792-55d5-42fa-95c0-a0f77d0c0736 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.036915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece82792-55d5-42fa-95c0-a0f77d0c0736 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.036915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece82792-55d5-42fa-95c0-a0f77d0c0736 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.038239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 545/1107] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:05.043443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505fce-6c02-4927-95be-f76bf8911253 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.043839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505fce-6c02-4927-95be-f76bf8911253 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.043989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505fce-6c02-4927-95be-f76bf8911253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.051188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.062815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d3505fce-6c02-4927-95be-f76bf8911253 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:05.063922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d3505fce-6c02-4927-95be-f76bf8911253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:05.128107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 563/1108] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:05.391755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece82792-55d5-42fa-95c0-a0f77d0c0736 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.488906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece82792-55d5-42fa-95c0-a0f77d0c0736 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.495954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.522947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b35ac-4015-4ada-b0e7-0d4c048b0817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.523559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b35ac-4015-4ada-b0e7-0d4c048b0817 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.523834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b35ac-4015-4ada-b0e7-0d4c048b0817 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.524101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b35ac-4015-4ada-b0e7-0d4c048b0817 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.525224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b35ac-4015-4ada-b0e7-0d4c048b0817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.526634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b35ac-4015-4ada-b0e7-0d4c048b0817 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.528153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 546/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:05.533722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3505fce-6c02-4927-95be-f76bf8911253 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:05.628819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3505fce-6c02-4927-95be-f76bf8911253 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:05.660343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060d13e-95eb-46ff-a612-28fb568b2311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:05.660870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d13e-95eb-46ff-a612-28fb568b2311 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:05.661177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d13e-95eb-46ff-a612-28fb568b2311 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:05.661448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d13e-95eb-46ff-a612-28fb568b2311 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:05.662088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060d13e-95eb-46ff-a612-28fb568b2311 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:05.663487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060d13e-95eb-46ff-a612-28fb568b2311 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:05.671738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:05.684954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 564/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:48:05 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:48:07.847535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c434d-f56d-43a2-b03c-347e88e1cb36 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:07.848044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c434d-f56d-43a2-b03c-347e88e1cb36 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:07.848155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c434d-f56d-43a2-b03c-347e88e1cb36 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:07.849433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 547/1111] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:07.854710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27416-c24a-4f98-8f40-acd6cbc85625 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:07.855132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27416-c24a-4f98-8f40-acd6cbc85625 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:07.855263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c27416-c24a-4f98-8f40-acd6cbc85625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:07.873094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-96c27416-c24a-4f98-8f40-acd6cbc85625 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:07.874540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-96c27416-c24a-4f98-8f40-acd6cbc85625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:07.938401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 565/1112] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:08.204935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c434d-f56d-43a2-b03c-347e88e1cb36 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.301236 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c434d-f56d-43a2-b03c-347e88e1cb36 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.334134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f576e3-d0b0-4df0-8038-5b31e78cd312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.334751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f576e3-d0b0-4df0-8038-5b31e78cd312 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.335032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f576e3-d0b0-4df0-8038-5b31e78cd312 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.335305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f576e3-d0b0-4df0-8038-5b31e78cd312 None admin] PATH_INFO: `/v3/roles/6c35be71800f4fd791345d48ca3f6ed2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.336689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f576e3-d0b0-4df0-8038-5b31e78cd312 None admin] RBAC: Authorizing `identity:get_role(role_id=6c35be71800f4fd791345d48ca3f6ed2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.338077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f576e3-d0b0-4df0-8038-5b31e78cd312 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.339358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 548/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/roles/6c35be71800f4fd791345d48ca3f6ed2 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:08.344928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c27416-c24a-4f98-8f40-acd6cbc85625 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.440061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c27416-c24a-4f98-8f40-acd6cbc85625 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.458981 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:08.474978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5cf3a-91b1-4b7e-ad12-446b2c47a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.475651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5cf3a-91b1-4b7e-ad12-446b2c47a93a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.475950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5cf3a-91b1-4b7e-ad12-446b2c47a93a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.476405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5cf3a-91b1-4b7e-ad12-446b2c47a93a None admin] PATH_INFO: `/v3/users/f0ce2edb206a4e9fbd619ee614931779` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.489788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5cf3a-91b1-4b7e-ad12-446b2c47a93a None admin] RBAC: Authorizing `identity:get_user(user_id=f0ce2edb206a4e9fbd619ee614931779)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.491221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5cf3a-91b1-4b7e-ad12-446b2c47a93a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.492795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 566/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/users/f0ce2edb206a4e9fbd619ee614931779 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:08.499546 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f576e3-d0b0-4df0-8038-5b31e78cd312 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.540820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:08.596158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f576e3-d0b0-4df0-8038-5b31e78cd312 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.629559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f3c9-214c-4152-9b38-23407e32c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.630157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f3c9-214c-4152-9b38-23407e32c3ce None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.630432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f3c9-214c-4152-9b38-23407e32c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.630701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f3c9-214c-4152-9b38-23407e32c3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.693817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42f3c9-214c-4152-9b38-23407e32c3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.695499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42f3c9-214c-4152-9b38-23407e32c3ce None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.734284 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:08.788196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 549/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:08.794185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5cf3a-91b1-4b7e-ad12-446b2c47a93a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:08.890707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5cf3a-91b1-4b7e-ad12-446b2c47a93a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:08.923425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea043f-b425-4bb7-a222-b6a7bc67abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:08.924039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea043f-b425-4bb7-a222-b6a7bc67abed None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:08.924315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea043f-b425-4bb7-a222-b6a7bc67abed None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:08.924582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea043f-b425-4bb7-a222-b6a7bc67abed None admin] PATH_INFO: `/v3/projects/4d390d04876042c88948c9bbb478feba` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:08.925700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea043f-b425-4bb7-a222-b6a7bc67abed None admin] RBAC: Authorizing `identity:get_project(project_id=4d390d04876042c88948c9bbb478feba)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:08.927114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea043f-b425-4bb7-a222-b6a7bc67abed None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:08.928697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 567/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/projects/4d390d04876042c88948c9bbb478feba => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:08.934831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f3c9-214c-4152-9b38-23407e32c3ce None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:09.029947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f3c9-214c-4152-9b38-23407e32c3ce None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:09.062156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e074188-fdae-45fa-8de6-ae8434fa2dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:09.062737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e074188-fdae-45fa-8de6-ae8434fa2dcb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:09.063012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e074188-fdae-45fa-8de6-ae8434fa2dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:09.063281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e074188-fdae-45fa-8de6-ae8434fa2dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:09.063987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e074188-fdae-45fa-8de6-ae8434fa2dcb None admin] RBAC: Adding query filter params (role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=4d390d04876042c88948c9bbb478feba, user.id=f0ce2edb206a4e9fbd619ee614931779) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:09.064287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e074188-fdae-45fa-8de6-ae8434fa2dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:09.065719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e074188-fdae-45fa-8de6-ae8434fa2dcb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:09.070781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 550/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:08 2022] GET /identity/v3/role_assignments?user.id=f0ce2edb206a4e9fbd619ee614931779&scope.project.id=4d390d04876042c88948c9bbb478feba&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:11.156548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b6cfc-f71c-4d4f-ac82-75777818ba8f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:11.157088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b6cfc-f71c-4d4f-ac82-75777818ba8f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:11.157088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b6cfc-f71c-4d4f-ac82-75777818ba8f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:11.158356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 568/1118] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:11.163522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdcbfe-ff26-4674-b3f4-1e1aff53b053 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:11.163928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdcbfe-ff26-4674-b3f4-1e1aff53b053 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:11.164067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdcbfe-ff26-4674-b3f4-1e1aff53b053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:11.177278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:11.182999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-29fdcbfe-ff26-4674-b3f4-1e1aff53b053 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:11.184168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-29fdcbfe-ff26-4674-b3f4-1e1aff53b053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:11.247385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 551/1119] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:11.516347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b6cfc-f71c-4d4f-ac82-75777818ba8f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:11.562720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:11.614894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b6cfc-f71c-4d4f-ac82-75777818ba8f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:11.647433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190c84-a11f-4d12-9499-ef9f2b13796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:11.648049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190c84-a11f-4d12-9499-ef9f2b13796b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:11.648327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190c84-a11f-4d12-9499-ef9f2b13796b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:11.648597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190c84-a11f-4d12-9499-ef9f2b13796b None admin] PATH_INFO: `/v3/roles/6c35be71800f4fd791345d48ca3f6ed2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:11.649973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190c84-a11f-4d12-9499-ef9f2b13796b None admin] RBAC: Authorizing `identity:get_role(role_id=6c35be71800f4fd791345d48ca3f6ed2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:11.651339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190c84-a11f-4d12-9499-ef9f2b13796b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:11.652613 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 569/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:11 2022] GET /identity/v3/roles/6c35be71800f4fd791345d48ca3f6ed2 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:11.658941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdcbfe-ff26-4674-b3f4-1e1aff53b053 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:11.752873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdcbfe-ff26-4674-b3f4-1e1aff53b053 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:11.785575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7213f-37af-4c31-9a6b-d75ae4e6babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:11.786184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7213f-37af-4c31-9a6b-d75ae4e6babe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:11.786463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7213f-37af-4c31-9a6b-d75ae4e6babe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:11.786733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7213f-37af-4c31-9a6b-d75ae4e6babe None admin] PATH_INFO: `/v3/users/f0ce2edb206a4e9fbd619ee614931779` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:11.787831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7213f-37af-4c31-9a6b-d75ae4e6babe None admin] RBAC: Authorizing `identity:get_user(user_id=f0ce2edb206a4e9fbd619ee614931779)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:11.789267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7213f-37af-4c31-9a6b-d75ae4e6babe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:11.790801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 552/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:11 2022] GET /identity/v3/users/f0ce2edb206a4e9fbd619ee614931779 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:11.796389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190c84-a11f-4d12-9499-ef9f2b13796b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:11.892006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190c84-a11f-4d12-9499-ef9f2b13796b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:11.905354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:11.924587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362d61f-6186-438a-b4d3-2d26d6247218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:11.925226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d61f-6186-438a-b4d3-2d26d6247218 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:11.925506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d61f-6186-438a-b4d3-2d26d6247218 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:11.925776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d61f-6186-438a-b4d3-2d26d6247218 None admin] PATH_INFO: `/v3/projects/4d390d04876042c88948c9bbb478feba` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:11.926871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362d61f-6186-438a-b4d3-2d26d6247218 None admin] RBAC: Authorizing `identity:get_project(project_id=4d390d04876042c88948c9bbb478feba)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:11.928295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362d61f-6186-438a-b4d3-2d26d6247218 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:11.929922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 570/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:11 2022] GET /identity/v3/projects/4d390d04876042c88948c9bbb478feba => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:11.936495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7213f-37af-4c31-9a6b-d75ae4e6babe None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:11.940198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:12.032228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7213f-37af-4c31-9a6b-d75ae4e6babe None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:12.063749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69fabe-5373-49f5-980c-f14b7501b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:12.064324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69fabe-5373-49f5-980c-f14b7501b092 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:12.064599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69fabe-5373-49f5-980c-f14b7501b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:12.064867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69fabe-5373-49f5-980c-f14b7501b092 None admin] PATH_INFO: `/v3/projects/4d390d04876042c88948c9bbb478feba/users/f0ce2edb206a4e9fbd619ee614931779/roles/6c35be71800f4fd791345d48ca3f6ed2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:12.066976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69fabe-5373-49f5-980c-f14b7501b092 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d390d04876042c88948c9bbb478feba, user_id=f0ce2edb206a4e9fbd619ee614931779, role_id=6c35be71800f4fd791345d48ca3f6ed2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:12.068477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69fabe-5373-49f5-980c-f14b7501b092 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:12.080659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 553/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:48:11 2022] PUT /identity/v3/projects/4d390d04876042c88948c9bbb478feba/users/f0ce2edb206a4e9fbd619ee614931779/roles/6c35be71800f4fd791345d48ca3f6ed2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:48:14.164649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c1051-ebca-4161-aed4-c751125d3a04 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.165179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c1051-ebca-4161-aed4-c751125d3a04 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.165179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c1051-ebca-4161-aed4-c751125d3a04 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.166462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 571/1124] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:14.171659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4797-07d1-4548-9e8a-d921c47129ca None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.172050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4797-07d1-4548-9e8a-d921c47129ca None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.172209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4797-07d1-4548-9e8a-d921c47129ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.190357 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-00cb4797-07d1-4548-9e8a-d921c47129ca None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:14.191530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-00cb4797-07d1-4548-9e8a-d921c47129ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:14.248166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:14.257080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 554/1125] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:14.521779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c1051-ebca-4161-aed4-c751125d3a04 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:14.620899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c1051-ebca-4161-aed4-c751125d3a04 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:14.653868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af09b6-3847-4394-8dc9-2a9a671448be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:14.654477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af09b6-3847-4394-8dc9-2a9a671448be None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.654754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af09b6-3847-4394-8dc9-2a9a671448be None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.655024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af09b6-3847-4394-8dc9-2a9a671448be None admin] PATH_INFO: `/v3/roles/6c35be71800f4fd791345d48ca3f6ed2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.656392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af09b6-3847-4394-8dc9-2a9a671448be None admin] RBAC: Authorizing `identity:get_role(role_id=6c35be71800f4fd791345d48ca3f6ed2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:14.657785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af09b6-3847-4394-8dc9-2a9a671448be None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:14.659063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 572/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:14 2022] GET /identity/v3/roles/6c35be71800f4fd791345d48ca3f6ed2 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:14.664893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb4797-07d1-4548-9e8a-d921c47129ca None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:14.759981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb4797-07d1-4548-9e8a-d921c47129ca None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:14.792414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967660a-b2d4-4616-a479-e27c9c6a14b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:14.793003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967660a-b2d4-4616-a479-e27c9c6a14b0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.793352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967660a-b2d4-4616-a479-e27c9c6a14b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.793627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967660a-b2d4-4616-a479-e27c9c6a14b0 None admin] PATH_INFO: `/v3/users/f0ce2edb206a4e9fbd619ee614931779` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.795340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967660a-b2d4-4616-a479-e27c9c6a14b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ce2edb206a4e9fbd619ee614931779)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:14.796845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967660a-b2d4-4616-a479-e27c9c6a14b0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:14.798407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 555/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:14 2022] GET /identity/v3/users/f0ce2edb206a4e9fbd619ee614931779 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:14.803973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af09b6-3847-4394-8dc9-2a9a671448be None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:14.851584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:14.898905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af09b6-3847-4394-8dc9-2a9a671448be None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:14.931728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2837-b5f6-46c7-8aae-b0e53b749f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:14.932321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2837-b5f6-46c7-8aae-b0e53b749f7a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:14.932594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2837-b5f6-46c7-8aae-b0e53b749f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:14.932861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2837-b5f6-46c7-8aae-b0e53b749f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:14.995490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f2837-b5f6-46c7-8aae-b0e53b749f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:14.996909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f2837-b5f6-46c7-8aae-b0e53b749f7a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:15.042041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:15.089674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 573/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:15.096108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967660a-b2d4-4616-a479-e27c9c6a14b0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:15.155243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:15.192344 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967660a-b2d4-4616-a479-e27c9c6a14b0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:15.224891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc38891-72d6-48ea-a270-3536a05440e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:15.225540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38891-72d6-48ea-a270-3536a05440e9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.225818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38891-72d6-48ea-a270-3536a05440e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.226090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc38891-72d6-48ea-a270-3536a05440e9 None admin] PATH_INFO: `/v3/projects/4d390d04876042c88948c9bbb478feba` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.227187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc38891-72d6-48ea-a270-3536a05440e9 None admin] RBAC: Authorizing `identity:get_project(project_id=4d390d04876042c88948c9bbb478feba)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:15.228596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc38891-72d6-48ea-a270-3536a05440e9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:15.230228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 556/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:15 2022] GET /identity/v3/projects/4d390d04876042c88948c9bbb478feba => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:15.236339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2837-b5f6-46c7-8aae-b0e53b749f7a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:15.330819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2837-b5f6-46c7-8aae-b0e53b749f7a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:15.363558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941cc79-bf4a-497d-a552-1e16642a9e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:15.364086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941cc79-bf4a-497d-a552-1e16642a9e77 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:15.364357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941cc79-bf4a-497d-a552-1e16642a9e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:15.364619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941cc79-bf4a-497d-a552-1e16642a9e77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:15.365356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941cc79-bf4a-497d-a552-1e16642a9e77 None admin] RBAC: Adding query filter params (role.id=6c35be71800f4fd791345d48ca3f6ed2, scope.project.id=4d390d04876042c88948c9bbb478feba, user.id=f0ce2edb206a4e9fbd619ee614931779) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:15.365653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941cc79-bf4a-497d-a552-1e16642a9e77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:15.367050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941cc79-bf4a-497d-a552-1e16642a9e77 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:15.372502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 574/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:15 2022] GET /identity/v3/role_assignments?user.id=f0ce2edb206a4e9fbd619ee614931779&scope.project.id=4d390d04876042c88948c9bbb478feba&role.id=6c35be71800f4fd791345d48ca3f6ed2 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:17.494345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fcc4c-cc88-4567-b4dd-870e1479ebd4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.494868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fcc4c-cc88-4567-b4dd-870e1479ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.494868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fcc4c-cc88-4567-b4dd-870e1479ebd4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.496210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 557/1131] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:17.501625 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6d69-0f63-4de2-933f-227a95343855 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.502028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6d69-0f63-4de2-933f-227a95343855 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.502171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6d69-0f63-4de2-933f-227a95343855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.520352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-df4e6d69-0f63-4de2-933f-227a95343855 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:17.521573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-df4e6d69-0f63-4de2-933f-227a95343855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:17.531076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:17.586541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 575/1132] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:17.852301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fcc4c-cc88-4567-b4dd-870e1479ebd4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:17.950173 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fcc4c-cc88-4567-b4dd-870e1479ebd4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:17.977091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:17.983019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f45cd5-774b-4fba-bb87-561de556361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:17.983628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f45cd5-774b-4fba-bb87-561de556361a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:17.983903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f45cd5-774b-4fba-bb87-561de556361a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:17.984168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f45cd5-774b-4fba-bb87-561de556361a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:17.985282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f45cd5-774b-4fba-bb87-561de556361a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:17.986685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f45cd5-774b-4fba-bb87-561de556361a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:17.988203 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 558/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:17.993993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6d69-0f63-4de2-933f-227a95343855 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:18.089517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6d69-0f63-4de2-933f-227a95343855 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:18.121504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a879d-406c-4a43-b826-06a1f2ccc8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:18.122097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a879d-406c-4a43-b826-06a1f2ccc8f9 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:18.122879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a879d-406c-4a43-b826-06a1f2ccc8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:18.123154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a879d-406c-4a43-b826-06a1f2ccc8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:18.124045 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a879d-406c-4a43-b826-06a1f2ccc8f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:18.125502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a879d-406c-4a43-b826-06a1f2ccc8f9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:18.140725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:18.152480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 576/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:17 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:48:20.288170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cf31c-7d6f-4748-8c6d-e04568a588a4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.288687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cf31c-7d6f-4748-8c6d-e04568a588a4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.288806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cf31c-7d6f-4748-8c6d-e04568a588a4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.290084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 559/1135] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:20.295870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aeefa-7f14-4a42-a5b2-a3e16eaeefa8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.296274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aeefa-7f14-4a42-a5b2-a3e16eaeefa8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.296422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aeefa-7f14-4a42-a5b2-a3e16eaeefa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.314104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-777aeefa-7f14-4a42-a5b2-a3e16eaeefa8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:20.315306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-777aeefa-7f14-4a42-a5b2-a3e16eaeefa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:20.379851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 577/1136] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:20.643756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cf31c-7d6f-4748-8c6d-e04568a588a4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:20.741630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cf31c-7d6f-4748-8c6d-e04568a588a4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:20.774416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abb52a-b382-40c7-a13f-157251eb5a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:20.775022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb52a-b382-40c7-a13f-157251eb5a6e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.775299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb52a-b382-40c7-a13f-157251eb5a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.775567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb52a-b382-40c7-a13f-157251eb5a6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.776655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb52a-b382-40c7-a13f-157251eb5a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:20.778100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb52a-b382-40c7-a13f-157251eb5a6e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:20.780181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 560/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:48:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:20.785774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aeefa-7f14-4a42-a5b2-a3e16eaeefa8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:20.880265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aeefa-7f14-4a42-a5b2-a3e16eaeefa8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:20.904912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:20.913562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf542c-59df-4b05-a673-7c32bd503127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:20.914158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf542c-59df-4b05-a673-7c32bd503127 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:20.914436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf542c-59df-4b05-a673-7c32bd503127 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:20.914707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf542c-59df-4b05-a673-7c32bd503127 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:20.915356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf542c-59df-4b05-a673-7c32bd503127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:20.916776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf542c-59df-4b05-a673-7c32bd503127 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:20.937390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 578/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:48:20 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:23.092822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eca97-e23a-4e1a-9166-346701a4a01b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.094656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eca97-e23a-4e1a-9166-346701a4a01b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.094656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22eca97-e23a-4e1a-9166-346701a4a01b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.094894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 561/1139] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:23.100232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fbd1-61a9-45d1-baa4-789223f766ac None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.100646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fbd1-61a9-45d1-baa4-789223f766ac None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.100821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63fbd1-61a9-45d1-baa4-789223f766ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.118540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ce63fbd1-61a9-45d1-baa4-789223f766ac None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:23.119712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ce63fbd1-61a9-45d1-baa4-789223f766ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:23.184138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 579/1140] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:23.462048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eca97-e23a-4e1a-9166-346701a4a01b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.527315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.562125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22eca97-e23a-4e1a-9166-346701a4a01b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.594097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b33fc-4a55-4fac-a628-9cae70ad36a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.594710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b33fc-4a55-4fac-a628-9cae70ad36a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.594989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b33fc-4a55-4fac-a628-9cae70ad36a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.595259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b33fc-4a55-4fac-a628-9cae70ad36a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.605044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b33fc-4a55-4fac-a628-9cae70ad36a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-672b33fc-4a55-4fac-a628-9cae70ad36a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:23.610365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:23.611561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:23.612712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 562/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:23.617405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63fbd1-61a9-45d1-baa4-789223f766ac None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.713240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63fbd1-61a9-45d1-baa4-789223f766ac None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.726417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.748600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.749483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.749760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.750032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.750687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:23.750987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.752357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.760105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 580/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:23.765916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b33fc-4a55-4fac-a628-9cae70ad36a2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:23.864870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b33fc-4a55-4fac-a628-9cae70ad36a2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:23.889746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:23.898782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edf497-b826-4a0e-86ed-73eda590e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:23.899404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf497-b826-4a0e-86ed-73eda590e70f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:23.899678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf497-b826-4a0e-86ed-73eda590e70f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:23.899947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edf497-b826-4a0e-86ed-73eda590e70f None admin] PATH_INFO: `/v3/users/285966e2752242ddbceff81a39f23660` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:23.913700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edf497-b826-4a0e-86ed-73eda590e70f None admin] RBAC: Authorizing `identity:get_user(user_id=285966e2752242ddbceff81a39f23660)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:23.915124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2edf497-b826-4a0e-86ed-73eda590e70f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:23.916677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 563/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/users/285966e2752242ddbceff81a39f23660 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:23.923165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.018059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8f9c1-df19-4047-824c-74375d7c17ce None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.050955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414af02-9350-49e2-a52d-1a6f87b0f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.051539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414af02-9350-49e2-a52d-1a6f87b0f02a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.051814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414af02-9350-49e2-a52d-1a6f87b0f02a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.052084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414af02-9350-49e2-a52d-1a6f87b0f02a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.092203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:24.116884 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414af02-9350-49e2-a52d-1a6f87b0f02a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.118343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414af02-9350-49e2-a52d-1a6f87b0f02a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.211696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 581/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:24.218165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edf497-b826-4a0e-86ed-73eda590e70f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.312013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edf497-b826-4a0e-86ed-73eda590e70f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.344816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb014a9-bcfa-4421-b52f-347afae18719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.345459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb014a9-bcfa-4421-b52f-347afae18719 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.345763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb014a9-bcfa-4421-b52f-347afae18719 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.346033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb014a9-bcfa-4421-b52f-347afae18719 None admin] PATH_INFO: `/v3/projects/da2dae4b9d6b4b1ea8c0d36706558515` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.347123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb014a9-bcfa-4421-b52f-347afae18719 None admin] RBAC: Authorizing `identity:get_project(project_id=da2dae4b9d6b4b1ea8c0d36706558515)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.348527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb014a9-bcfa-4421-b52f-347afae18719 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.350121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 564/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:24 2022] GET /identity/v3/projects/da2dae4b9d6b4b1ea8c0d36706558515 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:24.355988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414af02-9350-49e2-a52d-1a6f87b0f02a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:24.427549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:24.452169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414af02-9350-49e2-a52d-1a6f87b0f02a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:24.484447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7f309-ecea-4716-8e47-dc610d90e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:24.485058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f309-ecea-4716-8e47-dc610d90e2bb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:24.485335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f309-ecea-4716-8e47-dc610d90e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:24.485603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7f309-ecea-4716-8e47-dc610d90e2bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:24.486305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7f309-ecea-4716-8e47-dc610d90e2bb None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=da2dae4b9d6b4b1ea8c0d36706558515, user.id=285966e2752242ddbceff81a39f23660) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:24.486606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7f309-ecea-4716-8e47-dc610d90e2bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:24.488013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7f309-ecea-4716-8e47-dc610d90e2bb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:24.493443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 582/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:24 2022] GET /identity/v3/role_assignments?user.id=285966e2752242ddbceff81a39f23660&scope.project.id=da2dae4b9d6b4b1ea8c0d36706558515&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:26.600927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ac78a-f1b9-45ad-83f3-d776403eed3b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:26.601516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ac78a-f1b9-45ad-83f3-d776403eed3b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:26.601516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ac78a-f1b9-45ad-83f3-d776403eed3b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:26.602823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 565/1147] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:26.607972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3855-0c7d-4c56-9ad6-fd241eb38a23 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:26.608385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3855-0c7d-4c56-9ad6-fd241eb38a23 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:26.608530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3855-0c7d-4c56-9ad6-fd241eb38a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:26.626797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d38d3855-0c7d-4c56-9ad6-fd241eb38a23 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:26.627974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d38d3855-0c7d-4c56-9ad6-fd241eb38a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:26.691652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 583/1148] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:26.961385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ac78a-f1b9-45ad-83f3-d776403eed3b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.012587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:27.058129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ac78a-f1b9-45ad-83f3-d776403eed3b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.090996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282030bb-dff5-4835-bd63-70204fa05919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.091608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282030bb-dff5-4835-bd63-70204fa05919 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.091886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282030bb-dff5-4835-bd63-70204fa05919 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.092156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282030bb-dff5-4835-bd63-70204fa05919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.101853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282030bb-dff5-4835-bd63-70204fa05919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-282030bb-dff5-4835-bd63-70204fa05919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:27.106606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:27.107737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:27.108950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 566/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:27.113558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3855-0c7d-4c56-9ad6-fd241eb38a23 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.176324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:27.208237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3855-0c7d-4c56-9ad6-fd241eb38a23 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.240402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.240933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.241240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.241509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.242153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:27.242451 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:27.243802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:27.252233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 584/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:27.257899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282030bb-dff5-4835-bd63-70204fa05919 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.352996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282030bb-dff5-4835-bd63-70204fa05919 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.365995 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:27.386898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c03c9f-8805-40bd-b815-047a73e77ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.387512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c03c9f-8805-40bd-b815-047a73e77ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.387818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c03c9f-8805-40bd-b815-047a73e77ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.388091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c03c9f-8805-40bd-b815-047a73e77ab6 None admin] PATH_INFO: `/v3/users/285966e2752242ddbceff81a39f23660` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.389225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c03c9f-8805-40bd-b815-047a73e77ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=285966e2752242ddbceff81a39f23660)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:27.390640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c03c9f-8805-40bd-b815-047a73e77ab6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:27.392175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 567/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:27 2022] GET /identity/v3/users/285966e2752242ddbceff81a39f23660 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:27.397716 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.495503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153777a5-416c-4734-89ed-4b98d99d5679 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.522638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:27.528547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76791-8359-40a1-8a6c-1c9fa4bba54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.529192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76791-8359-40a1-8a6c-1c9fa4bba54d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.529469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76791-8359-40a1-8a6c-1c9fa4bba54d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.529737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76791-8359-40a1-8a6c-1c9fa4bba54d None admin] PATH_INFO: `/v3/projects/da2dae4b9d6b4b1ea8c0d36706558515` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.530824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76791-8359-40a1-8a6c-1c9fa4bba54d None admin] RBAC: Authorizing `identity:get_project(project_id=da2dae4b9d6b4b1ea8c0d36706558515)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:27.532245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76791-8359-40a1-8a6c-1c9fa4bba54d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:27.533870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 585/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:27 2022] GET /identity/v3/projects/da2dae4b9d6b4b1ea8c0d36706558515 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:27.539906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c03c9f-8805-40bd-b815-047a73e77ab6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:27.635914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c03c9f-8805-40bd-b815-047a73e77ab6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:27.667753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d47eba-290d-41db-8d9b-d8239965afb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:27.668390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d47eba-290d-41db-8d9b-d8239965afb1 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:27.668671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d47eba-290d-41db-8d9b-d8239965afb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:27.669580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d47eba-290d-41db-8d9b-d8239965afb1 None admin] PATH_INFO: `/v3/projects/da2dae4b9d6b4b1ea8c0d36706558515/users/285966e2752242ddbceff81a39f23660/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:27.671472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d47eba-290d-41db-8d9b-d8239965afb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=da2dae4b9d6b4b1ea8c0d36706558515, user_id=285966e2752242ddbceff81a39f23660, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:27.672880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d47eba-290d-41db-8d9b-d8239965afb1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:27.685022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 568/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:48:27 2022] PUT /identity/v3/projects/da2dae4b9d6b4b1ea8c0d36706558515/users/285966e2752242ddbceff81a39f23660/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:48:29.759529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352c6a0-b0a2-435d-8cd5-851a4d0f2088 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.760081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352c6a0-b0a2-435d-8cd5-851a4d0f2088 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.760081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352c6a0-b0a2-435d-8cd5-851a4d0f2088 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.761447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 586/1154] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:29.766547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063892-6d26-4452-a59d-591462300000 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:29.766979 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063892-6d26-4452-a59d-591462300000 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:29.767103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063892-6d26-4452-a59d-591462300000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:29.784750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6e063892-6d26-4452-a59d-591462300000 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:29.785965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6e063892-6d26-4452-a59d-591462300000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:29.819574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:29.852029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 569/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:30.120096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352c6a0-b0a2-435d-8cd5-851a4d0f2088 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.218167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352c6a0-b0a2-435d-8cd5-851a4d0f2088 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.249915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651884bb-1435-46da-8775-9582a8661ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.250546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651884bb-1435-46da-8775-9582a8661ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.250828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651884bb-1435-46da-8775-9582a8661ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.251103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651884bb-1435-46da-8775-9582a8661ee1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.261457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651884bb-1435-46da-8775-9582a8661ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-651884bb-1435-46da-8775-9582a8661ee1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:30.266719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:30.267882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:48:30.269169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 587/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:30.273657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e063892-6d26-4452-a59d-591462300000 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.368154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e063892-6d26-4452-a59d-591462300000 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.400614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.401171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.401452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.401721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.402368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:30.402666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:30.404590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:30.412236 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 570/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:30.418004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651884bb-1435-46da-8775-9582a8661ee1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.474936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.516034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651884bb-1435-46da-8775-9582a8661ee1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.548278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdffd49-9d2b-4002-b5ff-07335867215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.548885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdffd49-9d2b-4002-b5ff-07335867215d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.549192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdffd49-9d2b-4002-b5ff-07335867215d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.549465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdffd49-9d2b-4002-b5ff-07335867215d None admin] PATH_INFO: `/v3/users/285966e2752242ddbceff81a39f23660` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.550562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdffd49-9d2b-4002-b5ff-07335867215d None admin] RBAC: Authorizing `identity:get_user(user_id=285966e2752242ddbceff81a39f23660)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:30.551990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdffd49-9d2b-4002-b5ff-07335867215d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:30.553567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 588/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/users/285966e2752242ddbceff81a39f23660 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:30.559212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.590266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.656144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb58f8-96f5-4478-85c0-73e55144dfb9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.688023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb6f26-9acc-409a-8772-cf266cfa5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.688613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb6f26-9acc-409a-8772-cf266cfa5dbb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.688895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb6f26-9acc-409a-8772-cf266cfa5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.689193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb6f26-9acc-409a-8772-cf266cfa5dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.752993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb6f26-9acc-409a-8772-cf266cfa5dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:30.754407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb6f26-9acc-409a-8772-cf266cfa5dbb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:30.782605 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.851336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 571/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:30.857201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdffd49-9d2b-4002-b5ff-07335867215d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:30.953292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdffd49-9d2b-4002-b5ff-07335867215d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:30.976788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:30.986194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478609f0-6407-49a9-ba63-3bb836005aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:30.986809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478609f0-6407-49a9-ba63-3bb836005aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:30.987090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478609f0-6407-49a9-ba63-3bb836005aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:30.987363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478609f0-6407-49a9-ba63-3bb836005aa6 None admin] PATH_INFO: `/v3/projects/da2dae4b9d6b4b1ea8c0d36706558515` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:30.988465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478609f0-6407-49a9-ba63-3bb836005aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=da2dae4b9d6b4b1ea8c0d36706558515)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:30.989930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478609f0-6407-49a9-ba63-3bb836005aa6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:30.991518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 589/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/projects/da2dae4b9d6b4b1ea8c0d36706558515 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:30.998190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb6f26-9acc-409a-8772-cf266cfa5dbb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:31.092200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb6f26-9acc-409a-8772-cf266cfa5dbb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:31.119942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:31.125830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ef1f-4993-45a5-890d-92a98574ba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:31.126422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ef1f-4993-45a5-890d-92a98574ba89 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:31.126700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ef1f-4993-45a5-890d-92a98574ba89 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:31.126969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ef1f-4993-45a5-890d-92a98574ba89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:31.127678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ef1f-4993-45a5-890d-92a98574ba89 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=da2dae4b9d6b4b1ea8c0d36706558515, user.id=285966e2752242ddbceff81a39f23660) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:31.127981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ef1f-4993-45a5-890d-92a98574ba89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:31.129417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ef1f-4993-45a5-890d-92a98574ba89 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:31.134927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 572/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:30 2022] GET /identity/v3/role_assignments?user.id=285966e2752242ddbceff81a39f23660&scope.project.id=da2dae4b9d6b4b1ea8c0d36706558515&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:33.258195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059528d-a826-4742-bfde-deed6bc80945 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:33.258695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059528d-a826-4742-bfde-deed6bc80945 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:33.258695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059528d-a826-4742-bfde-deed6bc80945 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:33.259983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 590/1162] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:33.265111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3b736-93d1-47af-ac98-91761239d966 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:33.265496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3b736-93d1-47af-ac98-91761239d966 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:33.265655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3b736-93d1-47af-ac98-91761239d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:33.283229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-95a3b736-93d1-47af-ac98-91761239d966 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:33.284427 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-95a3b736-93d1-47af-ac98-91761239d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:33.347820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 573/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:33.616422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059528d-a826-4742-bfde-deed6bc80945 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:33.713283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059528d-a826-4742-bfde-deed6bc80945 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:33.745865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce56e3-5588-43fc-a17a-6e35ed5a24b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:33.746452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce56e3-5588-43fc-a17a-6e35ed5a24b0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:33.746728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce56e3-5588-43fc-a17a-6e35ed5a24b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:33.747022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce56e3-5588-43fc-a17a-6e35ed5a24b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:33.804591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:33.812321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce56e3-5588-43fc-a17a-6e35ed5a24b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:33.813804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce56e3-5588-43fc-a17a-6e35ed5a24b0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:33.909270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 591/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:33.915194 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3b736-93d1-47af-ac98-91761239d966 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:34.009616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3b736-93d1-47af-ac98-91761239d966 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:34.035161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:34.043473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286459b8-5094-48dd-8207-9c9b16f44742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:34.044123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286459b8-5094-48dd-8207-9c9b16f44742 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:34.044401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286459b8-5094-48dd-8207-9c9b16f44742 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:34.044669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286459b8-5094-48dd-8207-9c9b16f44742 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:34.051137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286459b8-5094-48dd-8207-9c9b16f44742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:34.052565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286459b8-5094-48dd-8207-9c9b16f44742 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-286459b8-5094-48dd-8207-9c9b16f44742 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:34.063583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:34.064786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:34.065706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 574/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:48:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:34.070856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce56e3-5588-43fc-a17a-6e35ed5a24b0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:34.158807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:34.165766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce56e3-5588-43fc-a17a-6e35ed5a24b0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:34.197502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2838361-6cbc-47d3-80f5-7f5675444c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:34.198091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838361-6cbc-47d3-80f5-7f5675444c45 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:34.198364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838361-6cbc-47d3-80f5-7f5675444c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:34.198631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2838361-6cbc-47d3-80f5-7f5675444c45 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:34.199260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2838361-6cbc-47d3-80f5-7f5675444c45 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:34.199557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2838361-6cbc-47d3-80f5-7f5675444c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:34.201476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2838361-6cbc-47d3-80f5-7f5675444c45 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:34.208417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 592/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 10 11:48:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:36.301731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5c60-46fd-4ab7-92d2-bbc5763a5961 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.302260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5c60-46fd-4ab7-92d2-bbc5763a5961 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.302260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba5c60-46fd-4ab7-92d2-bbc5763a5961 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.303614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 575/1167] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:36.309203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae535ec-7043-400a-ac3e-d261d5fd8253 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.309572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae535ec-7043-400a-ac3e-d261d5fd8253 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.309744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae535ec-7043-400a-ac3e-d261d5fd8253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.327746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cae535ec-7043-400a-ac3e-d261d5fd8253 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:36.328893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cae535ec-7043-400a-ac3e-d261d5fd8253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:36.391947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 593/1168] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:36.655469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba5c60-46fd-4ab7-92d2-bbc5763a5961 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:36.752845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba5c60-46fd-4ab7-92d2-bbc5763a5961 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:36.786569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35422ffc-d305-4e8d-a90a-515a03a18cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:36.787160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422ffc-d305-4e8d-a90a-515a03a18cea None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:36.787442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422ffc-d305-4e8d-a90a-515a03a18cea None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:36.787714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422ffc-d305-4e8d-a90a-515a03a18cea None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:36.788382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35422ffc-d305-4e8d-a90a-515a03a18cea None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:36.789760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35422ffc-d305-4e8d-a90a-515a03a18cea None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:36.805058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 576/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Mon Oct 10 11:48:36 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:38.956587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab8fc0-119b-4d6b-9682-1206276065ac None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.957142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab8fc0-119b-4d6b-9682-1206276065ac None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.957142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab8fc0-119b-4d6b-9682-1206276065ac None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.958498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 594/1170] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:38.963765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad42523-5008-4b29-bd3b-afafb181ed04 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:38.964178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad42523-5008-4b29-bd3b-afafb181ed04 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:38.964317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad42523-5008-4b29-bd3b-afafb181ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:38.981983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3ad42523-5008-4b29-bd3b-afafb181ed04 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:38.983154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3ad42523-5008-4b29-bd3b-afafb181ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:39.023748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:39.047798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 577/1171] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:39.318744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab8fc0-119b-4d6b-9682-1206276065ac None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.404286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:39.417171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab8fc0-119b-4d6b-9682-1206276065ac None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.450848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efe491-a6a2-475f-a602-f45316b77226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.451462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efe491-a6a2-475f-a602-f45316b77226 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.451743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efe491-a6a2-475f-a602-f45316b77226 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.452021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efe491-a6a2-475f-a602-f45316b77226 None admin] PATH_INFO: `/v3/domains/807d2295f7304f2f8292883618de3107` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.462065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efe491-a6a2-475f-a602-f45316b77226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=807d2295f7304f2f8292883618de3107)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.463507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efe491-a6a2-475f-a602-f45316b77226 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.465247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 595/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Mon Oct 10 11:48:39 2022] GET /identity/v3/domains/807d2295f7304f2f8292883618de3107 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:39.470998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad42523-5008-4b29-bd3b-afafb181ed04 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:39.564608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad42523-5008-4b29-bd3b-afafb181ed04 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:39.596693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6ee95-83b8-4ecb-9a2b-436fb703b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:39.597244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ee95-83b8-4ecb-9a2b-436fb703b353 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:39.597521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ee95-83b8-4ecb-9a2b-436fb703b353 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:39.597788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6ee95-83b8-4ecb-9a2b-436fb703b353 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:39.598432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6ee95-83b8-4ecb-9a2b-436fb703b353 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:39.599830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6ee95-83b8-4ecb-9a2b-436fb703b353 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:39.625176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 578/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:48:39 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:41.757858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9ed6a-2201-4d1a-bba9-b0e81e0b11d9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:41.758384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9ed6a-2201-4d1a-bba9-b0e81e0b11d9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:41.758384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9ed6a-2201-4d1a-bba9-b0e81e0b11d9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:41.759703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 596/1174] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:41.765535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33bb9-568b-4c0d-b733-3873ef39bc42 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:41.765919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33bb9-568b-4c0d-b733-3873ef39bc42 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:41.766085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b33bb9-568b-4c0d-b733-3873ef39bc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:41.784807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-91b33bb9-568b-4c0d-b733-3873ef39bc42 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:41.786022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-91b33bb9-568b-4c0d-b733-3873ef39bc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:41.807717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:41.851106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 579/1175] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:42.119276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9ed6a-2201-4d1a-bba9-b0e81e0b11d9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.217505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9ed6a-2201-4d1a-bba9-b0e81e0b11d9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.250134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1e851-e51e-4165-9f88-06ea41490afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.250832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1e851-e51e-4165-9f88-06ea41490afc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.251110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1e851-e51e-4165-9f88-06ea41490afc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.251378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1e851-e51e-4165-9f88-06ea41490afc None admin] PATH_INFO: `/v3/domains/807d2295f7304f2f8292883618de3107` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.252467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1e851-e51e-4165-9f88-06ea41490afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=807d2295f7304f2f8292883618de3107)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.253916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1e851-e51e-4165-9f88-06ea41490afc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.255423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 597/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Mon Oct 10 11:48:42 2022] GET /identity/v3/domains/807d2295f7304f2f8292883618de3107 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:42.261073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b33bb9-568b-4c0d-b733-3873ef39bc42 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:42.353847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b33bb9-568b-4c0d-b733-3873ef39bc42 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:42.386979 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6a4e0-bb60-4866-9e64-b9921241fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:42.387536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a4e0-bb60-4866-9e64-b9921241fde1 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:42.387814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a4e0-bb60-4866-9e64-b9921241fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:42.388083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6a4e0-bb60-4866-9e64-b9921241fde1 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:42.388712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a4e0-bb60-4866-9e64-b9921241fde1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:42.390148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6a4e0-bb60-4866-9e64-b9921241fde1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:42.411168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 580/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:48:42 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:48:44.564584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308e1e-c4cc-4b4e-9c5a-d1a43158a93a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:44.565149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308e1e-c4cc-4b4e-9c5a-d1a43158a93a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:44.565149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308e1e-c4cc-4b4e-9c5a-d1a43158a93a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:44.566467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 598/1178] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:44.571568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b023-314d-4536-b3a2-79805e0df5c7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:44.571962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b023-314d-4536-b3a2-79805e0df5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:44.572124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554b023-314d-4536-b3a2-79805e0df5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:44.590631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2554b023-314d-4536-b3a2-79805e0df5c7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:44.591796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2554b023-314d-4536-b3a2-79805e0df5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:44.600645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:44.656505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 581/1179] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:44.928373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308e1e-c4cc-4b4e-9c5a-d1a43158a93a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:44.946526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:45.027575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308e1e-c4cc-4b4e-9c5a-d1a43158a93a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:45.060675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682d70e-ec2c-488b-8375-d40cc5ea550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:45.061388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682d70e-ec2c-488b-8375-d40cc5ea550c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.061668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682d70e-ec2c-488b-8375-d40cc5ea550c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.061939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682d70e-ec2c-488b-8375-d40cc5ea550c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.072813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682d70e-ec2c-488b-8375-d40cc5ea550c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5682d70e-ec2c-488b-8375-d40cc5ea550c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:45.077604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:45.078729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:48:45.079793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 599/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:45.084651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554b023-314d-4536-b3a2-79805e0df5c7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:45.178939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554b023-314d-4536-b3a2-79805e0df5c7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:45.211269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:45.211860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.212136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.212403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.213078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:45.213382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:45.214730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:45.222971 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 582/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:45.228603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682d70e-ec2c-488b-8375-d40cc5ea550c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:45.301586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:45.324137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682d70e-ec2c-488b-8375-d40cc5ea550c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:45.356309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229c3cb-f6e7-43b1-a103-b930862cb034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:45.356915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229c3cb-f6e7-43b1-a103-b930862cb034 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.357218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229c3cb-f6e7-43b1-a103-b930862cb034 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.357492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229c3cb-f6e7-43b1-a103-b930862cb034 None admin] PATH_INFO: `/v3/users/97dc2808afb34d97aee223ee38cb784d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.370118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229c3cb-f6e7-43b1-a103-b930862cb034 None admin] RBAC: Authorizing `identity:get_user(user_id=97dc2808afb34d97aee223ee38cb784d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:45.371567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229c3cb-f6e7-43b1-a103-b930862cb034 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:45.373132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 600/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:45 2022] GET /identity/v3/users/97dc2808afb34d97aee223ee38cb784d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:45.378928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:45.388440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:45.476187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d63839-c7e7-461c-8459-e2e8eb165a9f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:45.508128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394c83-c75b-4c3b-bd50-0c9a9cff9f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:45.508721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394c83-c75b-4c3b-bd50-0c9a9cff9f1e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.509034 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394c83-c75b-4c3b-bd50-0c9a9cff9f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.509308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394c83-c75b-4c3b-bd50-0c9a9cff9f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.573661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f394c83-c75b-4c3b-bd50-0c9a9cff9f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:45.575727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f394c83-c75b-4c3b-bd50-0c9a9cff9f1e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:45.583096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:45.669298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 583/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:45.675131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229c3cb-f6e7-43b1-a103-b930862cb034 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:45.770381 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229c3cb-f6e7-43b1-a103-b930862cb034 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:45.801877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea8e39-5374-44c6-aa91-10f518706935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:45.802487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8e39-5374-44c6-aa91-10f518706935 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.802762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8e39-5374-44c6-aa91-10f518706935 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.803031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8e39-5374-44c6-aa91-10f518706935 None admin] PATH_INFO: `/v3/projects/0a060074a5b444e39856292d47837743` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.804128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea8e39-5374-44c6-aa91-10f518706935 None admin] RBAC: Authorizing `identity:get_project(project_id=0a060074a5b444e39856292d47837743)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:45.805591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea8e39-5374-44c6-aa91-10f518706935 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:45.807190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 601/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:45 2022] GET /identity/v3/projects/0a060074a5b444e39856292d47837743 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:45.813764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394c83-c75b-4c3b-bd50-0c9a9cff9f1e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:45.907368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394c83-c75b-4c3b-bd50-0c9a9cff9f1e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:45.914281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:45.940759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fb368-72a9-4bb9-bafc-7153bb8c5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:45.941374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb368-72a9-4bb9-bafc-7153bb8c5756 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:45.941651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb368-72a9-4bb9-bafc-7153bb8c5756 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:45.941916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb368-72a9-4bb9-bafc-7153bb8c5756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:45.942653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fb368-72a9-4bb9-bafc-7153bb8c5756 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=0a060074a5b444e39856292d47837743, user.id=97dc2808afb34d97aee223ee38cb784d) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:45.942953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fb368-72a9-4bb9-bafc-7153bb8c5756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:45.944351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fb368-72a9-4bb9-bafc-7153bb8c5756 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:45.949605 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 584/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:45 2022] GET /identity/v3/role_assignments?user.id=97dc2808afb34d97aee223ee38cb784d&scope.project.id=0a060074a5b444e39856292d47837743&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:48:48.038818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca5e9-1bce-4214-9687-b8a6b1d978f6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.039340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca5e9-1bce-4214-9687-b8a6b1d978f6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.039340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca5e9-1bce-4214-9687-b8a6b1d978f6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.040667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 602/1186] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:48.046324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b179341-c7d1-49ab-aabe-a338fcc05318 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.046742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b179341-c7d1-49ab-aabe-a338fcc05318 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.046878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b179341-c7d1-49ab-aabe-a338fcc05318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.064515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5b179341-c7d1-49ab-aabe-a338fcc05318 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:48.065814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5b179341-c7d1-49ab-aabe-a338fcc05318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:48.129834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 585/1187] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:48.402034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ca5e9-1bce-4214-9687-b8a6b1d978f6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.405447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.499903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ca5e9-1bce-4214-9687-b8a6b1d978f6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.532853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333fa56-0cff-4f6d-99ef-0444a88c863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.533492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333fa56-0cff-4f6d-99ef-0444a88c863f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.533771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333fa56-0cff-4f6d-99ef-0444a88c863f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.534042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333fa56-0cff-4f6d-99ef-0444a88c863f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.543715 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333fa56-0cff-4f6d-99ef-0444a88c863f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4333fa56-0cff-4f6d-99ef-0444a88c863f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:48.548471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:48.549598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:48:48.550471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 603/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:48.555426 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b179341-c7d1-49ab-aabe-a338fcc05318 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.647873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.650689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b179341-c7d1-49ab-aabe-a338fcc05318 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.682657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.683191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.683465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.683729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.684904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:48.685232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.686604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.694258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 586/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:48.701042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333fa56-0cff-4f6d-99ef-0444a88c863f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.759579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:48.797049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333fa56-0cff-4f6d-99ef-0444a88c863f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.830784 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd44b8-ae50-4d4b-ab12-a2346d8b267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.831408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd44b8-ae50-4d4b-ab12-a2346d8b267b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.831688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd44b8-ae50-4d4b-ab12-a2346d8b267b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.831968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd44b8-ae50-4d4b-ab12-a2346d8b267b None admin] PATH_INFO: `/v3/users/97dc2808afb34d97aee223ee38cb784d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.833107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd44b8-ae50-4d4b-ab12-a2346d8b267b None admin] RBAC: Authorizing `identity:get_user(user_id=97dc2808afb34d97aee223ee38cb784d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.834536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd44b8-ae50-4d4b-ab12-a2346d8b267b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.836098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 604/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/users/97dc2808afb34d97aee223ee38cb784d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:48.842113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:48.937580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f594c9-05eb-4ef0-a742-aada0b7e0ccf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:48.968411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97237d6e-d7fc-4e17-ba7a-c3481a07bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:48.969056 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97237d6e-d7fc-4e17-ba7a-c3481a07bc9e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:48.969340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97237d6e-d7fc-4e17-ba7a-c3481a07bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:48.969605 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97237d6e-d7fc-4e17-ba7a-c3481a07bc9e None admin] PATH_INFO: `/v3/projects/0a060074a5b444e39856292d47837743` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:48.970678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97237d6e-d7fc-4e17-ba7a-c3481a07bc9e None admin] RBAC: Authorizing `identity:get_project(project_id=0a060074a5b444e39856292d47837743)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:48.972076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97237d6e-d7fc-4e17-ba7a-c3481a07bc9e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:48.973670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 587/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:48 2022] GET /identity/v3/projects/0a060074a5b444e39856292d47837743 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:48.979541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd44b8-ae50-4d4b-ab12-a2346d8b267b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:49.075669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd44b8-ae50-4d4b-ab12-a2346d8b267b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:49.103282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:49.109899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35b6af-4a04-49ac-a6cd-2e66d1c7dfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:49.110545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b6af-4a04-49ac-a6cd-2e66d1c7dfdf None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:49.110821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b6af-4a04-49ac-a6cd-2e66d1c7dfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:49.111090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35b6af-4a04-49ac-a6cd-2e66d1c7dfdf None admin] PATH_INFO: `/v3/projects/0a060074a5b444e39856292d47837743/users/97dc2808afb34d97aee223ee38cb784d/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:49.112950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35b6af-4a04-49ac-a6cd-2e66d1c7dfdf None admin] RBAC: Authorizing `identity:create_grant(project_id=0a060074a5b444e39856292d47837743, user_id=97dc2808afb34d97aee223ee38cb784d, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:49.114417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35b6af-4a04-49ac-a6cd-2e66d1c7dfdf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:49.127284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 605/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:48:48 2022] PUT /identity/v3/projects/0a060074a5b444e39856292d47837743/users/97dc2808afb34d97aee223ee38cb784d/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:48:51.222659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08443b8-da91-4e80-9d39-4f37742a51bf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.223167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08443b8-da91-4e80-9d39-4f37742a51bf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.223167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08443b8-da91-4e80-9d39-4f37742a51bf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.224445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 588/1193] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:48:51.229609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d17e5-e36d-4f91-95d5-b2d204c958f7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.229985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d17e5-e36d-4f91-95d5-b2d204c958f7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.230144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d17e5-e36d-4f91-95d5-b2d204c958f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.247732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e47d17e5-e36d-4f91-95d5-b2d204c958f7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:48:51.249194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e47d17e5-e36d-4f91-95d5-b2d204c958f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:48:51.312558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 606/1194] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:48:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:48:51.576740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08443b8-da91-4e80-9d39-4f37742a51bf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:51.606357 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:51.674807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08443b8-da91-4e80-9d39-4f37742a51bf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:51.707478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d1c12-2eed-4836-82d4-ae8ffac08b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:51.708118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d1c12-2eed-4836-82d4-ae8ffac08b5a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.708398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d1c12-2eed-4836-82d4-ae8ffac08b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.708665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d1c12-2eed-4836-82d4-ae8ffac08b5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.718387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d1c12-2eed-4836-82d4-ae8ffac08b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bd8d1c12-2eed-4836-82d4-ae8ffac08b5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:48:51.723124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:48:51.724200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:48:51.725250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 589/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:48:51.730034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d17e5-e36d-4f91-95d5-b2d204c958f7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:51.827481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d17e5-e36d-4f91-95d5-b2d204c958f7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:51.846683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:51.861100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:51.861701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:51.861979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:51.862248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:51.862897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:51.863201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:51.864565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:51.872882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 607/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:51.879020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d1c12-2eed-4836-82d4-ae8ffac08b5a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:51.966014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:51.977865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d1c12-2eed-4836-82d4-ae8ffac08b5a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.011363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf387c-a38d-4575-b8b5-2202215960d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.011998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf387c-a38d-4575-b8b5-2202215960d0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.012281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf387c-a38d-4575-b8b5-2202215960d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.012552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf387c-a38d-4575-b8b5-2202215960d0 None admin] PATH_INFO: `/v3/users/97dc2808afb34d97aee223ee38cb784d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.013678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf387c-a38d-4575-b8b5-2202215960d0 None admin] RBAC: Authorizing `identity:get_user(user_id=97dc2808afb34d97aee223ee38cb784d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.015091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf387c-a38d-4575-b8b5-2202215960d0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.016650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 590/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 10 11:48:51 2022] GET /identity/v3/users/97dc2808afb34d97aee223ee38cb784d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:52.022459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.118632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39f47-2adf-4674-a0c4-4fdd5f5db7f9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.150745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8bad-838f-4731-9ef8-140c78b69ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.151334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8bad-838f-4731-9ef8-140c78b69ead None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.151607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8bad-838f-4731-9ef8-140c78b69ead None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.151874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8bad-838f-4731-9ef8-140c78b69ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.198389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:52.216535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c8bad-838f-4731-9ef8-140c78b69ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.217982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c8bad-838f-4731-9ef8-140c78b69ead None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.311270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 608/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:48:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:48:52.317389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf387c-a38d-4575-b8b5-2202215960d0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.412696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf387c-a38d-4575-b8b5-2202215960d0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.444336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2202ac7-67f0-48d0-b779-721d9d338077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.444941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2202ac7-67f0-48d0-b779-721d9d338077 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.445251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2202ac7-67f0-48d0-b779-721d9d338077 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.445518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2202ac7-67f0-48d0-b779-721d9d338077 None admin] PATH_INFO: `/v3/projects/0a060074a5b444e39856292d47837743` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.446608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2202ac7-67f0-48d0-b779-721d9d338077 None admin] RBAC: Authorizing `identity:get_project(project_id=0a060074a5b444e39856292d47837743)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.448014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2202ac7-67f0-48d0-b779-721d9d338077 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.449646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 591/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 10 11:48:52 2022] GET /identity/v3/projects/0a060074a5b444e39856292d47837743 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:48:52.455473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8bad-838f-4731-9ef8-140c78b69ead None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:48:52.533691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:48:52.551732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8bad-838f-4731-9ef8-140c78b69ead None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:48:52.583602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dec51-01e8-4279-8648-8b05ccd64716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:48:52.584190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dec51-01e8-4279-8648-8b05ccd64716 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:48:52.584464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dec51-01e8-4279-8648-8b05ccd64716 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:48:52.584733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dec51-01e8-4279-8648-8b05ccd64716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:48:52.585468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dec51-01e8-4279-8648-8b05ccd64716 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=0a060074a5b444e39856292d47837743, user.id=97dc2808afb34d97aee223ee38cb784d) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:48:52.585767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dec51-01e8-4279-8648-8b05ccd64716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:48:52.587185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19dec51-01e8-4279-8648-8b05ccd64716 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:48:52.593245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 609/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:48:52 2022] GET /identity/v3/role_assignments?user.id=97dc2808afb34d97aee223ee38cb784d&scope.project.id=0a060074a5b444e39856292d47837743&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:02.440334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:02.590220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=27 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:47.496830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022864a-0f21-4e81-9879-fa264f397400 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:47.497452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022864a-0f21-4e81-9879-fa264f397400 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:47.497452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022864a-0f21-4e81-9879-fa264f397400 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:47.499058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 592/1201] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:47.504920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616fc9-e428-46c7-9f29-bafd0906288f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:47.504920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616fc9-e428-46c7-9f29-bafd0906288f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:47.505462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1616fc9-e428-46c7-9f29-bafd0906288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:47.527800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d1616fc9-e428-46c7-9f29-bafd0906288f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:47.529134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d1616fc9-e428-46c7-9f29-bafd0906288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:47.615341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 610/1202] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:47.904614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022864a-0f21-4e81-9879-fa264f397400 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:48.036945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022864a-0f21-4e81-9879-fa264f397400 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:48.077505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:48.078093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:48.081025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:48.081025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:48.093520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:48.095202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:48.111523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:48.112631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:48.118589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:48.118589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:48.118589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:49:48.118589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 593/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:48.119025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1616fc9-e428-46c7-9f29-bafd0906288f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:48.237832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1616fc9-e428-46c7-9f29-bafd0906288f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:48.272773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:48.284079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a397c6-6037-48f7-8f36-1e00edc293a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:48.284698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a397c6-6037-48f7-8f36-1e00edc293a8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:48.285017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a397c6-6037-48f7-8f36-1e00edc293a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:48.285274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a397c6-6037-48f7-8f36-1e00edc293a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:48.285945 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a397c6-6037-48f7-8f36-1e00edc293a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:48.286218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a397c6-6037-48f7-8f36-1e00edc293a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:48.287596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a397c6-6037-48f7-8f36-1e00edc293a8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:48.305023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 611/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:48.309134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:48.369972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:48.426493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f4100-8ecc-4ee1-b75a-4555af7a5fcf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:48.479013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85e86-25a3-4edb-bb2e-993b66db4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:48.479677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85e86-25a3-4edb-bb2e-993b66db4e94 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:48.480023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85e86-25a3-4edb-bb2e-993b66db4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:48.480301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85e86-25a3-4edb-bb2e-993b66db4e94 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:48.481101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d85e86-25a3-4edb-bb2e-993b66db4e94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:48.482674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d85e86-25a3-4edb-bb2e-993b66db4e94 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:48.508168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 594/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 10 11:49:48 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:49:50.860937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051148-402f-4b88-9aa9-200a5abf2167 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:50.861496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051148-402f-4b88-9aa9-200a5abf2167 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:50.861496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2051148-402f-4b88-9aa9-200a5abf2167 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:50.862997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 612/1206] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:50.868162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ed59-dd07-4910-9256-520ab7f6642f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:50.868598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ed59-dd07-4910-9256-520ab7f6642f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:50.868695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01ed59-dd07-4910-9256-520ab7f6642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:50.888157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0f01ed59-dd07-4910-9256-520ab7f6642f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:50.889390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0f01ed59-dd07-4910-9256-520ab7f6642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:50.967906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 595/1207] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:49:51.243747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2051148-402f-4b88-9aa9-200a5abf2167 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:51.363500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2051148-402f-4b88-9aa9-200a5abf2167 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:51.412019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca4054-c294-48b0-a5bf-c09bbdb4957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:51.412651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca4054-c294-48b0-a5bf-c09bbdb4957b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:51.412953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca4054-c294-48b0-a5bf-c09bbdb4957b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:51.413219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca4054-c294-48b0-a5bf-c09bbdb4957b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:51.427339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca4054-c294-48b0-a5bf-c09bbdb4957b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4aca4054-c294-48b0-a5bf-c09bbdb4957b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:51.432392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:51.433626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:49:51.434506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 613/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:49:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:51.441798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ed59-dd07-4910-9256-520ab7f6642f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:51.482943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:51.548470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01ed59-dd07-4910-9256-520ab7f6642f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:51.585611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:51.586499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:51.586780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:51.587069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:51.587711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:51.588011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:51.589403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:51.597941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 596/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:49:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:51.603955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca4054-c294-48b0-a5bf-c09bbdb4957b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:51.665397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:51.726835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca4054-c294-48b0-a5bf-c09bbdb4957b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:51.765058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:51.765705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:51.765984 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:51.766253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:51.777957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:51.779861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:51.795101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:51.796185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:51.799618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:51.799618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:51.799618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:49:51.799618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 614/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:51.802256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:51.922182 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:51.925444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838291c-d590-41f3-a563-a46508af2ab4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:51.971372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:51.972070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:51.972483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:51.972743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:51.973559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:51.973866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:51.975417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:51.990556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 597/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:51.996753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:52.129489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb454bf-5042-43f7-ae33-a37b1998ee4c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:52.131109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:52.166883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:52.167514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.167804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.168601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.177410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:52.178927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:49:52.191502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:52.192591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:49:52.193631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 615/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:49:52.200600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:52.302686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b29bca-0625-4da2-ae68-e025d8297ec0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:52.341423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:52.342039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.342320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.342589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.343311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:52.343608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:52.345043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:52.365696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 598/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 10 11:49:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:52.372003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:52.485300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a310-6240-4f82-b39d-c51b4b72f1bf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:52.525059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506d51e-3313-4697-8d26-284d36a8c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:52.525672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506d51e-3313-4697-8d26-284d36a8c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.526034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506d51e-3313-4697-8d26-284d36a8c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.526314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506d51e-3313-4697-8d26-284d36a8c4f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.566835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:52.607506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506d51e-3313-4697-8d26-284d36a8c4f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:52.608960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506d51e-3313-4697-8d26-284d36a8c4f0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:52.721565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 616/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:49:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:49:52.727425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:52.748717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:52.850740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399684e-005b-4e9c-9ca6-710d86511517 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:52.893341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:52.893980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:52.894288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:52.894560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:52.905506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:52.906943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:52.922108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:52.923667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:52.924592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:52.924592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:52.924592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:49:52.924592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 599/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:52.929526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506d51e-3313-4697-8d26-284d36a8c4f0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:53.000806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:53.044429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506d51e-3313-4697-8d26-284d36a8c4f0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:53.088699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:53.089388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:53.090250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:53.090591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:53.091394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:53.091744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:53.093589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:53.111823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 617/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:53.117290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:53.203027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:53.235526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18f3e2-32e6-4eac-9a35-0959c3d34821 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:53.270036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:53.270668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:53.270945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:53.271217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:53.278986 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:53.280558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:49:53.291946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:53.294151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:49:53.295334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 600/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:53.299539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:53.411979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e4662-583d-4e7a-b8d7-9c4657469ae3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:53.436891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:53.450308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6d55d-3cc7-47db-a397-8e946df0c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:53.450889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6d55d-3cc7-47db-a397-8e946df0c9cb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:53.451169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6d55d-3cc7-47db-a397-8e946df0c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:53.451480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6d55d-3cc7-47db-a397-8e946df0c9cb None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:53.452180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6d55d-3cc7-47db-a397-8e946df0c9cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:53.452536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6d55d-3cc7-47db-a397-8e946df0c9cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:53.453950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6d55d-3cc7-47db-a397-8e946df0c9cb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:53.466913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 618/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:49:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:53.473295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:53.587006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bd179-8861-4fa2-8f81-b63c4357e64f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:53.616229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:53.622254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34bb2a-bdf7-45ed-a899-5d18a37aa773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:53.622861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb2a-bdf7-45ed-a899-5d18a37aa773 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:53.623145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb2a-bdf7-45ed-a899-5d18a37aa773 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:53.623407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34bb2a-bdf7-45ed-a899-5d18a37aa773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:53.624172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34bb2a-bdf7-45ed-a899-5d18a37aa773 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=397ce721f9684753b304f5c3b96c8a40) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:53.624419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34bb2a-bdf7-45ed-a899-5d18a37aa773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:53.626145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34bb2a-bdf7-45ed-a899-5d18a37aa773 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:53.631499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 601/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:49:53 2022] GET /identity/v3/role_assignments?user.id=397ce721f9684753b304f5c3b96c8a40&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:55.895018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1914c-010e-4e0d-9bcd-67d0ff83fac6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:55.895566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1914c-010e-4e0d-9bcd-67d0ff83fac6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:55.895566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1914c-010e-4e0d-9bcd-67d0ff83fac6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:55.896886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 619/1220] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:49:55.902066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09bf7-1c43-4980-8305-2632d7a1a338 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:55.903056 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09bf7-1c43-4980-8305-2632d7a1a338 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:55.903200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09bf7-1c43-4980-8305-2632d7a1a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:55.921643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-86b09bf7-1c43-4980-8305-2632d7a1a338 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:49:55.922856 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-86b09bf7-1c43-4980-8305-2632d7a1a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:49:55.990241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 602/1221] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:49:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:49:56.330261 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1914c-010e-4e0d-9bcd-67d0ff83fac6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.446508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1914c-010e-4e0d-9bcd-67d0ff83fac6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:56.488870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a55199-61fa-4da1-96d3-6da67a35e62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:56.489538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a55199-61fa-4da1-96d3-6da67a35e62c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:56.490084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a55199-61fa-4da1-96d3-6da67a35e62c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:56.490558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a55199-61fa-4da1-96d3-6da67a35e62c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:56.507213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a55199-61fa-4da1-96d3-6da67a35e62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-a3a55199-61fa-4da1-96d3-6da67a35e62c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:49:56.512720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:56.513764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:49:56.514628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 620/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:49:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:56.521201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09bf7-1c43-4980-8305-2632d7a1a338 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.631806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09bf7-1c43-4980-8305-2632d7a1a338 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:56.659571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:56.672996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:56.673641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:56.673912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:56.674178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:56.674837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:56.675134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:56.676480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:56.685093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 603/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:49:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:56.691222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a55199-61fa-4da1-96d3-6da67a35e62c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.734823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:56.799505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a55199-61fa-4da1-96d3-6da67a35e62c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:56.841548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:56.842193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:56.842518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:56.842832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:56.855318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:56.857791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:56.874132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:56.875244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:56.876437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:56.876437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:56.876437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:49:56.880218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 621/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:56.881512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:56.999275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aca10-a04d-4e26-8124-71ed4b3a1366 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:57.034992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:57.035604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:57.035882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:57.036151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:57.036797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:57.037138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:57.038504 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:57.051623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 604/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:57.057711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:57.165948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:57.174552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c06a-6fcb-4467-8f0c-f9a66501f28a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:57.217273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:57.217959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:57.218209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:57.218482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:57.226167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:57.227779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:49:57.239604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:57.241091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:49:57.242193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 622/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:57.246797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:57.298336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:57.362372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73980f65-ace5-453c-92a2-ba4bb4510d7c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:57.404307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:57.404915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:57.405227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:57.405520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:57.408081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:57.408081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:57.408081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:57.427776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 605/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 10 11:49:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:57.433724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:57.547653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee0907-1520-471f-a2fd-57cb7ed66114 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:57.582556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:57.583138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:57.583411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:57.583680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:57.594295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:57.595730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:49:57.610080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:57.611518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:49:57.612659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:49:57.612659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:49:57.612659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:49:57.612659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 623/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:57.617836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:57.723919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87242e19-e6c2-4b30-bf98-62af09f25f86 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:57.726614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:57.764109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:57.764792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:57.765160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:57.765466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:57.766183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:57.766501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:57.769466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:57.782511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 606/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:57.788427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:57.799038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:57.901667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79ec95-670f-4034-a745-79e8f037aa33 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:57.939565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:57.940307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:57.940661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:57.940941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:57.948734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:57.950981 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:49:57.964175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:49:57.965962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:49:57.966907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 624/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:49:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:49:57.972813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:58.081561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b982-4ff8-46e3-9a29-ca7f81e18a6d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:58.118026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0630f6-9085-4ec3-a4b6-71d737330403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:58.118708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0630f6-9085-4ec3-a4b6-71d737330403 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:58.119032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0630f6-9085-4ec3-a4b6-71d737330403 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:58.119376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0630f6-9085-4ec3-a4b6-71d737330403 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:58.120163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0630f6-9085-4ec3-a4b6-71d737330403 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:49:58.120497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0630f6-9085-4ec3-a4b6-71d737330403 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:58.122169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0630f6-9085-4ec3-a4b6-71d737330403 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:58.134326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 607/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:49:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:49:58.140994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:49:58.208525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:49:58.244138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19299ed2-d8d7-496a-b711-4bbfc9919003 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:49:58.280594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a656c33-d4fa-4956-96b3-cba7713f6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:49:58.281276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a656c33-d4fa-4956-96b3-cba7713f6ae7 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:49:58.281553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a656c33-d4fa-4956-96b3-cba7713f6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:49:58.281823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a656c33-d4fa-4956-96b3-cba7713f6ae7 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/397ce721f9684753b304f5c3b96c8a40/roles/858c9a6a274b4003940fa3798a1d4ec2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:49:58.298283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a656c33-d4fa-4956-96b3-cba7713f6ae7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=397ce721f9684753b304f5c3b96c8a40, role_id=858c9a6a274b4003940fa3798a1d4ec2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:49:58.299727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a656c33-d4fa-4956-96b3-cba7713f6ae7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:49:58.314316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 625/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:49:58 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/397ce721f9684753b304f5c3b96c8a40/roles/858c9a6a274b4003940fa3798a1d4ec2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:50:00.444908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33de81-b1b0-4f31-bf26-3a36b4a7aea6 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:00.445521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33de81-b1b0-4f31-bf26-3a36b4a7aea6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:00.445521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33de81-b1b0-4f31-bf26-3a36b4a7aea6 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:00.446904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 608/1233] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:50:00.453234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2dc9-51ba-4057-8e80-b9e62747f734 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:00.453655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2dc9-51ba-4057-8e80-b9e62747f734 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:00.453912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2dc9-51ba-4057-8e80-b9e62747f734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:00.474231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-efcd2dc9-51ba-4057-8e80-b9e62747f734 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:50:00.475433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-efcd2dc9-51ba-4057-8e80-b9e62747f734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:50:00.546487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 626/1234] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:50:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:50:00.821267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33de81-b1b0-4f31-bf26-3a36b4a7aea6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:00.848382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:00.928767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33de81-b1b0-4f31-bf26-3a36b4a7aea6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:00.963236 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b5cbf-4e25-4388-a1f0-ea2bec80b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:00.963862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5cbf-4e25-4388-a1f0-ea2bec80b73e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:00.964140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5cbf-4e25-4388-a1f0-ea2bec80b73e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:00.964413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b5cbf-4e25-4388-a1f0-ea2bec80b73e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:00.974777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b5cbf-4e25-4388-a1f0-ea2bec80b73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-895b5cbf-4e25-4388-a1f0-ea2bec80b73e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:50:00.979606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:00.981592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:00.982862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 609/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 10 11:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:00.987721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2dc9-51ba-4057-8e80-b9e62747f734 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:01.035718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:01.094671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2dc9-51ba-4057-8e80-b9e62747f734 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:01.132580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:01.133226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:01.133502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:01.133775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:01.134432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:01.134731 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:01.136278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:01.146091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 627/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 10 11:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:01.152168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b5cbf-4e25-4388-a1f0-ea2bec80b73e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:01.246068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:01.264035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b5cbf-4e25-4388-a1f0-ea2bec80b73e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:01.302102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:01.302741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:01.303037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:01.303375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:01.314844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:01.316279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:50:01.332421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:01.333716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:50:01.334806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:50:01.334806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:01.334806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:01.334806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 610/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:01.340394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:01.454686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6493313-c6dd-4e61-8d69-f842f52dc91e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:01.463659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:01.494071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:01.494882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:01.495182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:01.495460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:01.496315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:01.496628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:01.498231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:01.518589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 628/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:01.520104 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:01.628157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954785-5717-4af4-8a5f-40d80c594597 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:01.665473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:01.666227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:01.666507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:01.666850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:01.670279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:01.676488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:01.677995 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:50:01.689455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:01.690577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:01.691539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 611/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:01.696581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:01.802280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b3f37-789c-41e3-862c-fe25b24838b6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:01.841496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:01.842211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:01.842528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:01.842860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:01.843645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:01.844027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:01.845758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:01.865243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 629/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 10 11:50:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:01.871783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:01.980422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aac80-1110-4fb6-bddc-6ee0d924e425 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:02.016314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627392-9ad5-406e-9b3b-7e3210bf88a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:02.016923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627392-9ad5-406e-9b3b-7e3210bf88a1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:02.017231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627392-9ad5-406e-9b3b-7e3210bf88a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:02.017501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627392-9ad5-406e-9b3b-7e3210bf88a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:02.086623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:02.093794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93627392-9ad5-406e-9b3b-7e3210bf88a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:02.095301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93627392-9ad5-406e-9b3b-7e3210bf88a1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:02.203425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 612/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:50:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:50:02.210948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:02.238192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:02.322974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82fa1-50f3-49da-98e3-8fb21c5ffd30 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:02.363644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:02.364198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:02.364473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:02.364735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:02.377357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:02.378816 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:50:02.393970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:02.395172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:50:02.396368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:50:02.396368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:02.396368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:02.396368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 630/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:02.401564 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627392-9ad5-406e-9b3b-7e3210bf88a1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:02.501604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:02.508036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627392-9ad5-406e-9b3b-7e3210bf88a1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:02.547540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:02.548230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:02.548499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:02.548837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:02.549591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:02.549929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:02.551350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:02.564146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 613/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:02.570040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:02.657337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:02.682484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f7d16-b4b3-4a07-a169-46197df1dc1a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:02.718268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:02.718900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:02.719195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:02.719443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:02.725953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:02.727395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:50:02.740512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:02.741754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:02.743147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 631/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:02.748191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:02.870658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ad364-db00-4afb-b851-40dd9d6cb3ac None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:02.907060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82312e1a-6f88-4528-b8b6-681417da8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:02.907754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312e1a-6f88-4528-b8b6-681417da8c6d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:02.907955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312e1a-6f88-4528-b8b6-681417da8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:02.908224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312e1a-6f88-4528-b8b6-681417da8c6d None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:02.908908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82312e1a-6f88-4528-b8b6-681417da8c6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:02.909242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82312e1a-6f88-4528-b8b6-681417da8c6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:02.910660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82312e1a-6f88-4528-b8b6-681417da8c6d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:02.923672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 614/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:02.929705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:03.038686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c5cf3-32ba-4762-a145-4c2a1c1d5b71 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:03.080376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e783-5339-44d9-bfac-fa4e9742a381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:03.081076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e783-5339-44d9-bfac-fa4e9742a381 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:03.081352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e783-5339-44d9-bfac-fa4e9742a381 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:03.081618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e783-5339-44d9-bfac-fa4e9742a381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:03.082340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e783-5339-44d9-bfac-fa4e9742a381 None admin] RBAC: Adding query filter params (role.id=858c9a6a274b4003940fa3798a1d4ec2, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=397ce721f9684753b304f5c3b96c8a40) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:03.082641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e783-5339-44d9-bfac-fa4e9742a381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:03.084077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e783-5339-44d9-bfac-fa4e9742a381 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:03.091507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 632/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:50:02 2022] GET /identity/v3/role_assignments?user.id=397ce721f9684753b304f5c3b96c8a40&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=858c9a6a274b4003940fa3798a1d4ec2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:05.379090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107d91-7e95-4d86-998b-6e9479579a0d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:05.379690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107d91-7e95-4d86-998b-6e9479579a0d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:05.379690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25107d91-7e95-4d86-998b-6e9479579a0d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:05.381125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 615/1247] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:50:05.386495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a07d-6c4b-4c16-b6a6-cd76b4e179a9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:05.387517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a07d-6c4b-4c16-b6a6-cd76b4e179a9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:05.387737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6a07d-6c4b-4c16-b6a6-cd76b4e179a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:05.394733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:05.408883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-10a6a07d-6c4b-4c16-b6a6-cd76b4e179a9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:50:05.410086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-10a6a07d-6c4b-4c16-b6a6-cd76b4e179a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:50:05.489935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 633/1248] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:50:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:50:05.756461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25107d91-7e95-4d86-998b-6e9479579a0d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:05.774852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:05.870147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25107d91-7e95-4d86-998b-6e9479579a0d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:05.908209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920105-8f96-494e-8d1e-cb228b8b860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:05.908844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920105-8f96-494e-8d1e-cb228b8b860d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:05.909227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920105-8f96-494e-8d1e-cb228b8b860d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:05.909555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15920105-8f96-494e-8d1e-cb228b8b860d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:05.921068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15920105-8f96-494e-8d1e-cb228b8b860d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-15920105-8f96-494e-8d1e-cb228b8b860d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:50:05.926424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:05.927675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:05.928536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 616/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:50:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:05.934114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6a07d-6c4b-4c16-b6a6-cd76b4e179a9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:06.038893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6a07d-6c4b-4c16-b6a6-cd76b4e179a9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:06.071272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:06.076470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:06.077444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:06.077939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:06.078456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:06.079214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:06.079656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:06.081240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:06.089431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 634/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:50:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:06.095706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920105-8f96-494e-8d1e-cb228b8b860d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:06.175501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:06.200077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15920105-8f96-494e-8d1e-cb228b8b860d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:06.236940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:06.237613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:06.237895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:06.238169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:06.248795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:06.250479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:50:06.267252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:06.268476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:50:06.269935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:50:06.269935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:06.269935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:06.269935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 617/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:50:06.274732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:06.381996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60f3b6-5e08-4169-9d5c-1f2aab5662d3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:06.417327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:06.418008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:06.418510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:06.418793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:06.419719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:06.420259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:06.422234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:06.437310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 635/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:06.442937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:06.552639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe9e17-0b23-4737-9008-cd3144023120 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:06.581700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:06.590698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:06.591493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:06.591766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:06.592202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:06.600235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:06.601951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:50:06.613817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:06.615170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:06.616225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 618/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:50:06.621836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:06.682442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:06.734585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a538553-b0c9-44e3-b72c-3915dcfcaeb7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:06.783021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:06.783654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:06.783935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:06.784206 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:06.784952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:06.785291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:06.786768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:06.806869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 636/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 10 11:50:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:06.812491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:06.917135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966cc53e-78c6-477c-94c3-65acda040088 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:06.952621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b610889-633e-4f9d-853d-5ac451bb0943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:06.953177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610889-633e-4f9d-853d-5ac451bb0943 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:06.953459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610889-633e-4f9d-853d-5ac451bb0943 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:06.953737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b610889-633e-4f9d-853d-5ac451bb0943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:07.011896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:07.024943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b610889-633e-4f9d-853d-5ac451bb0943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:07.026426 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b610889-633e-4f9d-853d-5ac451bb0943 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:07.131547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 619/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:50:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:50:07.137621 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:07.239510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78046-8161-4a06-8f62-18d36c44f839 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:07.253466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:07.275248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:07.275879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:07.276159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:07.276431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:07.286545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:07.287996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:50:07.304243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:07.305489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:50:07.306618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:50:07.306618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:07.306618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:07.306618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 637/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:07.311215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b610889-633e-4f9d-853d-5ac451bb0943 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:07.398089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:07.410438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b610889-633e-4f9d-853d-5ac451bb0943 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:07.442915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:07.443503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:07.444024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:07.444024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:07.444639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:07.444936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:07.446312 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:07.456910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 620/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:07.462637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:07.565844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69605d-bc3b-456d-b977-9dc9a2932c7d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:07.597938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:07.598560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:07.598832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:07.599099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:07.605438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:07.607480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:50:07.618157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:07.619200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:07.620104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 638/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:50:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:07.625128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:07.721014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a89df-9613-406b-9af1-4f8c4b05f10a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:07.752466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbbc3d-9dd2-4076-aa53-ac93eadec4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:07.753080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbbc3d-9dd2-4076-aa53-ac93eadec4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:07.753363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbbc3d-9dd2-4076-aa53-ac93eadec4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:07.753636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbbc3d-9dd2-4076-aa53-ac93eadec4b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:07.754309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbbc3d-9dd2-4076-aa53-ac93eadec4b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:07.754611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbbc3d-9dd2-4076-aa53-ac93eadec4b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:07.756011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbbc3d-9dd2-4076-aa53-ac93eadec4b2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:07.767830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 621/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:07.773691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:07.798978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:07.870921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c457de-c140-4263-b1b6-abf999e4671b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:07.903467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f6c0c-6ac6-4671-8af4-6f9bad157457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:07.904055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6c0c-6ac6-4671-8af4-6f9bad157457 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:07.904330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6c0c-6ac6-4671-8af4-6f9bad157457 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:07.904598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f6c0c-6ac6-4671-8af4-6f9bad157457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:07.905334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f6c0c-6ac6-4671-8af4-6f9bad157457 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=397ce721f9684753b304f5c3b96c8a40) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:07.905638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f6c0c-6ac6-4671-8af4-6f9bad157457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:07.907045 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f6c0c-6ac6-4671-8af4-6f9bad157457 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:07.912154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 639/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:50:07 2022] GET /identity/v3/role_assignments?user.id=397ce721f9684753b304f5c3b96c8a40&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:10.020603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8749-e4be-4a90-a981-cd22eb73c61d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:10.021149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8749-e4be-4a90-a981-cd22eb73c61d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:10.021235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd8749-e4be-4a90-a981-cd22eb73c61d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:10.022525 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 622/1261] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:50:10.027579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654575c0-b7c6-4731-9680-2db944bd193a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:10.027950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654575c0-b7c6-4731-9680-2db944bd193a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:10.028132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654575c0-b7c6-4731-9680-2db944bd193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:10.046343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-654575c0-b7c6-4731-9680-2db944bd193a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:50:10.047509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-654575c0-b7c6-4731-9680-2db944bd193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:50:10.111701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 640/1262] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:50:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 10 11:50:10.375006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8749-e4be-4a90-a981-cd22eb73c61d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:10.385943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:10.474406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd8749-e4be-4a90-a981-cd22eb73c61d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:10.509992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc143d2-658e-464b-8d67-8ca159ab5a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:10.510788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc143d2-658e-464b-8d67-8ca159ab5a2b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:10.511146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc143d2-658e-464b-8d67-8ca159ab5a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:10.511597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc143d2-658e-464b-8d67-8ca159ab5a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:10.524624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc143d2-658e-464b-8d67-8ca159ab5a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4bc143d2-658e-464b-8d67-8ca159ab5a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:50:10.531399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:10.532509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:10.533662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 623/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:50:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:10.539466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654575c0-b7c6-4731-9680-2db944bd193a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:10.558888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:10.636899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654575c0-b7c6-4731-9680-2db944bd193a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:10.669404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:10.669995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:10.670271 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:10.670538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:10.671184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:10.671487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:10.672843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:10.680425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 641/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:10.686124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc143d2-658e-464b-8d67-8ca159ab5a2b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:10.749544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:10.781489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc143d2-658e-464b-8d67-8ca159ab5a2b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:10.813276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:10.813791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:10.814066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:10.814334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:10.823982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:10.826006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:50:10.839780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:10.841508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:50:10.842655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:50:10.842655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:10.842655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:10.842655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 624/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:10.847150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:10.928026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:10.947917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102234e-ad68-4fb0-97c2-cf02338d8f5b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:10.982028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:10.982643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:10.982926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:10.983202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:10.983842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:10.984201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:10.985625 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:10.998125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 642/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:11.004063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:11.105500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfafbae-8187-4fbf-a2fc-cbe47bffa698 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:11.125228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:11.140743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:11.141420 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:11.141707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:11.141977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:11.149327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:11.150750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:50:11.162402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:11.163506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:11.164487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 625/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:11.169342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:11.266002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7746e5-fadd-40bf-845c-0a4c8f7f5e69 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:11.298769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:11.299359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:11.299637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:11.299905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:11.300625 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:11.300928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:11.302411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:11.311214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:11.319480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 643/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 10 11:50:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:11.325919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:11.421328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217eeeb-a912-4072-90a1-0d22337b432a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:11.452958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:11.453591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:11.453867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:11.454135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:11.464052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:11.465515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:50:11.479303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:11.480528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:50:11.482134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:50:11.482134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:11.482134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:11.482134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 626/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 10 11:50:11.486686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:11.588280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483fce6-f9aa-4bfa-9ffa-05a3f30f7e49 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:11.620749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:11.621934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:11.622215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:11.622485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:11.623117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:11.623416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:11.624778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:11.635741 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 644/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:11.641382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:11.672287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:11.738029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b748c29-44dc-4b5f-9e47-aeaf12512f55 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:11.770306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:11.770918 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:11.771198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:11.771471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:11.777879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:11.779294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:50:11.790279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:11.791301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:11.796337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 627/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:11.797507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:11.854565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:11.895724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a70ff-18d3-42e4-a252-64955ecd113d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:11.928756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76015d7f-75b9-4241-90ed-60d6291a2c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:11.929382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015d7f-75b9-4241-90ed-60d6291a2c20 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:11.929662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015d7f-75b9-4241-90ed-60d6291a2c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:11.929931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015d7f-75b9-4241-90ed-60d6291a2c20 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:11.930608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76015d7f-75b9-4241-90ed-60d6291a2c20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:11.930910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76015d7f-75b9-4241-90ed-60d6291a2c20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:11.932318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76015d7f-75b9-4241-90ed-60d6291a2c20 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:11.943889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 645/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:11.949892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:12.036925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:12.046392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0215-aa99-4665-baa4-dde2fbb883a1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:12.077792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f946a60-0cb7-4ff9-82d6-6e3f9817f518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:12.078431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946a60-0cb7-4ff9-82d6-6e3f9817f518 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:12.078712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946a60-0cb7-4ff9-82d6-6e3f9817f518 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:12.078980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f946a60-0cb7-4ff9-82d6-6e3f9817f518 None admin] PATH_INFO: `/v3/projects/9118f2e751384123a1ef0d81235be544/users/397ce721f9684753b304f5c3b96c8a40/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:12.080809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946a60-0cb7-4ff9-82d6-6e3f9817f518 None admin] RBAC: Authorizing `identity:create_grant(project_id=9118f2e751384123a1ef0d81235be544, user_id=397ce721f9684753b304f5c3b96c8a40, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:12.082239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f946a60-0cb7-4ff9-82d6-6e3f9817f518 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:12.094855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 628/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 10 11:50:11 2022] PUT /identity/v3/projects/9118f2e751384123a1ef0d81235be544/users/397ce721f9684753b304f5c3b96c8a40/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:50:14.188511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750deff-5bb6-455f-b224-cfcb1355bf73 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:14.189044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750deff-5bb6-455f-b224-cfcb1355bf73 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:14.189044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750deff-5bb6-455f-b224-cfcb1355bf73 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:14.190341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 646/1274] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:50:14.195427 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc60f-91b3-4f31-99a0-b4ec3b06c365 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:14.195791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc60f-91b3-4f31-99a0-b4ec3b06c365 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:14.195976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cc60f-91b3-4f31-99a0-b4ec3b06c365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:14.214136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f51cc60f-91b3-4f31-99a0-b4ec3b06c365 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:50:14.215333 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f51cc60f-91b3-4f31-99a0-b4ec3b06c365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:50:14.280346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 629/1275] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:50:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:50:14.564794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750deff-5bb6-455f-b224-cfcb1355bf73 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:14.660825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750deff-5bb6-455f-b224-cfcb1355bf73 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:14.677482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:14.694000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fc63d-a93d-49ea-9586-9d6d8315a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:14.694607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc63d-a93d-49ea-9586-9d6d8315a749 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:14.694882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc63d-a93d-49ea-9586-9d6d8315a749 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:14.695149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fc63d-a93d-49ea-9586-9d6d8315a749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:14.704678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fc63d-a93d-49ea-9586-9d6d8315a749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8e8fc63d-a93d-49ea-9586-9d6d8315a749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 10 11:50:14.709371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:14.710507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:14.711595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 647/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 10 11:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:14.716452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc60f-91b3-4f31-99a0-b4ec3b06c365 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:14.792874 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:14.812870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cc60f-91b3-4f31-99a0-b4ec3b06c365 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:14.845768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:14.846304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:14.846582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:14.846849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:14.847487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:14.847786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:14.849157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:14.857435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 630/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 10 11:50:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:14.863150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fc63d-a93d-49ea-9586-9d6d8315a749 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:14.958158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fc63d-a93d-49ea-9586-9d6d8315a749 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:14.990962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:14.991566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:14.991837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:14.992101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:15.001883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:15.003309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:50:15.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:15.018960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:50:15.020304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:50:15.020304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:15.020304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:15.020304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 648/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:15.024530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:15.120911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec14b1-e3e4-4698-a5be-7007121c1b7b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:15.153146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:15.153738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:15.154020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:15.154294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:15.154924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:15.155225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:15.156576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:15.167744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 631/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:15.173917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:15.203839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:15.270437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee332c-89c7-440f-876c-cd7c73d8d3ff None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:15.302576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:15.303185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:15.303464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:15.303737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:15.310852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:15.312294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 10 11:50:15.323113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:15.324186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:15.325752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 649/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:15.330624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:15.334401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:15.427216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef71670-5422-4bb6-9cd0-43b1b61f0ee9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:15.459534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:15.460125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:15.460405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:15.460676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:15.461418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:15.461725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:15.463131 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:15.480880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 632/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 10 11:50:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:15.487037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:15.575901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:15.585503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aff36-3c89-43eb-8d9f-7b7794b8328d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:15.617462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e5d57-2ba0-4d72-9262-f785e884cfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:15.618053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e5d57-2ba0-4d72-9262-f785e884cfef None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:15.618334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e5d57-2ba0-4d72-9262-f785e884cfef None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:15.618603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e5d57-2ba0-4d72-9262-f785e884cfef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:15.682697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e5d57-2ba0-4d72-9262-f785e884cfef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:15.684593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e5d57-2ba0-4d72-9262-f785e884cfef None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:15.768515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:15.778990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 650/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 10 11:50:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 10 11:50:15.784731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:15.844046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:15.881654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811272a2-e370-404b-a49d-7ffb0439f2d7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:15.914270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:15.914890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:15.915171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:15.915444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:15.925720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:15.927162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 10 11:50:15.941784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:15.942895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 10 11:50:15.944039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 10 11:50:15.944039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 10 11:50:15.944039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:15.944039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 633/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:15.948482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e5d57-2ba0-4d72-9262-f785e884cfef None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:16.042520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e5d57-2ba0-4d72-9262-f785e884cfef None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:16.075258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:16.075845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:16.076125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:16.076391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:16.077036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:16.077335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:16.078680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:16.089236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 651/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 10 11:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:16.094712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:16.192819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8a3d-3834-47a9-829b-e2af39362d6d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:16.205696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:16.225527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:16.226139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:16.226414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:16.226681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:16.233478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:16.234889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 10 11:50:16.245622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:16.247242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Oct 10 11:50:16.248341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 634/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 10 11:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:16.253356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:16.301188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:16.350660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18305448-a43b-487e-bee5-d484033d8450 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:16.382835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584153c-e531-439e-bf3c-5b0739f69eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:16.383419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584153c-e531-439e-bf3c-5b0739f69eba None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:16.383695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584153c-e531-439e-bf3c-5b0739f69eba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:16.383963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584153c-e531-439e-bf3c-5b0739f69eba None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:16.384633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584153c-e531-439e-bf3c-5b0739f69eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:16.384932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584153c-e531-439e-bf3c-5b0739f69eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:16.386355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584153c-e531-439e-bf3c-5b0739f69eba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:16.397560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 652/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 10 11:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:16.403940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:16.505262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a860aa-41f8-4919-bc0d-fb18300dc3e5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:16.536889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81bb9-6ea2-4f47-bdc3-e6cbfed18fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:16.537504 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81bb9-6ea2-4f47-bdc3-e6cbfed18fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:16.537781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81bb9-6ea2-4f47-bdc3-e6cbfed18fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:16.538047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81bb9-6ea2-4f47-bdc3-e6cbfed18fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:16.538747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f81bb9-6ea2-4f47-bdc3-e6cbfed18fe1 None admin] RBAC: Adding query filter params (role.id=1f1b5ca5262b4535b5bb55f915b2f1b9, scope.project.id=9118f2e751384123a1ef0d81235be544, user.id=397ce721f9684753b304f5c3b96c8a40) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:16.539047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f81bb9-6ea2-4f47-bdc3-e6cbfed18fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:16.540460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f81bb9-6ea2-4f47-bdc3-e6cbfed18fe1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:16.546511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 635/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 10 11:50:16 2022] GET /identity/v3/role_assignments?user.id=397ce721f9684753b304f5c3b96c8a40&scope.project.id=9118f2e751384123a1ef0d81235be544&role.id=1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:18.687881 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2312-7427-4db3-a69e-2abdea28fd69 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:18.688409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2312-7427-4db3-a69e-2abdea28fd69 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:18.688409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb2312-7427-4db3-a69e-2abdea28fd69 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:18.689791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 653/1288] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:50:18.694968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec5e1-d915-41d4-801e-b9a4450a39c6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:18.695368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec5e1-d915-41d4-801e-b9a4450a39c6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:18.695523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec5e1-d915-41d4-801e-b9a4450a39c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:18.713300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-526ec5e1-d915-41d4-801e-b9a4450a39c6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:50:18.714477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-526ec5e1-d915-41d4-801e-b9a4450a39c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:50:18.743784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:18.780115 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 636/1289] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:50:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:50:19.045742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb2312-7427-4db3-a69e-2abdea28fd69 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:19.143225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb2312-7427-4db3-a69e-2abdea28fd69 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:19.153327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:19.177240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:19.177851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:19.178124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:19.178385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:19.178945 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:19.180296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:19.189425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:19.190628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:19.191487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 654/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:50:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:19.196432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ec5e1-d915-41d4-801e-b9a4450a39c6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:19.291132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ec5e1-d915-41d4-801e-b9a4450a39c6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:19.324036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc2d48-4115-45dd-b140-8337936591d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:19.324601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc2d48-4115-45dd-b140-8337936591d8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:19.324881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc2d48-4115-45dd-b140-8337936591d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:19.325195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc2d48-4115-45dd-b140-8337936591d8 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:19.325813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc2d48-4115-45dd-b140-8337936591d8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:19.326117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc2d48-4115-45dd-b140-8337936591d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:19.327461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc2d48-4115-45dd-b140-8337936591d8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:19.332050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 637/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Oct 10 11:50:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:19.337493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:19.432923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3169d-5f18-46af-bf98-a0eea36414c8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:19.463828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebc97e-02a4-4c15-8428-f8d2988fe14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:19.464404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebc97e-02a4-4c15-8428-f8d2988fe14d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:19.464676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebc97e-02a4-4c15-8428-f8d2988fe14d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:19.464941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebc97e-02a4-4c15-8428-f8d2988fe14d None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:19.466088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebc97e-02a4-4c15-8428-f8d2988fe14d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:19.466385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebc97e-02a4-4c15-8428-f8d2988fe14d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:19.467727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebc97e-02a4-4c15-8428-f8d2988fe14d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:19.471874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 655/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Oct 10 11:50:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:21.600768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536bfa0-b09d-4f27-bd04-76365e7e2c4c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:21.601335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536bfa0-b09d-4f27-bd04-76365e7e2c4c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:21.601335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536bfa0-b09d-4f27-bd04-76365e7e2c4c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:21.602690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 638/1293] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:50:21.608134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9122-3a09-4c80-9603-2120ec9fbc9b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:21.608511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9122-3a09-4c80-9603-2120ec9fbc9b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:21.608672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9122-3a09-4c80-9603-2120ec9fbc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:21.627080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dedc9122-3a09-4c80-9603-2120ec9fbc9b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:50:21.628235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dedc9122-3a09-4c80-9603-2120ec9fbc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:50:21.656344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:21.691715 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 656/1294] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:50:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:50:21.955246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536bfa0-b09d-4f27-bd04-76365e7e2c4c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:21.985538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:22.053848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536bfa0-b09d-4f27-bd04-76365e7e2c4c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:22.086513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395742df-6030-497e-bd25-c57b67a40915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:22.087107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395742df-6030-497e-bd25-c57b67a40915 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:22.087385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395742df-6030-497e-bd25-c57b67a40915 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:22.087653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395742df-6030-497e-bd25-c57b67a40915 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:22.088298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395742df-6030-497e-bd25-c57b67a40915 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:22.089677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395742df-6030-497e-bd25-c57b67a40915 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:22.103008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 639/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 10 11:50:21 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:50:24.217837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a55f-af0d-4d2f-a756-53b0101d5bb2 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:24.218330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a55f-af0d-4d2f-a756-53b0101d5bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:24.218330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8a55f-af0d-4d2f-a756-53b0101d5bb2 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:24.219667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 657/1296] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:50:24.224741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc76d3-95eb-41b0-b816-2142db77800c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:24.225207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc76d3-95eb-41b0-b816-2142db77800c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:24.225318 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc76d3-95eb-41b0-b816-2142db77800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:24.243587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-41fc76d3-95eb-41b0-b816-2142db77800c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:50:24.244766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-41fc76d3-95eb-41b0-b816-2142db77800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:50:24.314934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 640/1297] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:50:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:50:24.594158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8a55f-af0d-4d2f-a756-53b0101d5bb2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:24.692520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8a55f-af0d-4d2f-a756-53b0101d5bb2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:24.725214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:24.725825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:24.726104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:24.726375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:24.726947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:24.728304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:24.737404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:24.738553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:24.739443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 658/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:50:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:24.744309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc76d3-95eb-41b0-b816-2142db77800c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:24.762057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:24.839628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc76d3-95eb-41b0-b816-2142db77800c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:24.872663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:24.873231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:24.873516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:24.873791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:24.874414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:24.874717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:24.876075 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:24.881270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 641/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Oct 10 11:50:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:24.887163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:24.917831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:24.983958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e90c1d-99ce-4427-93c6-488ce99a2233 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:25.016084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d888-d28a-4b8a-86c4-fbe7214ddc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:25.016666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d888-d28a-4b8a-86c4-fbe7214ddc4a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:25.016966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d888-d28a-4b8a-86c4-fbe7214ddc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:25.017264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d888-d28a-4b8a-86c4-fbe7214ddc4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:25.017951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33d888-d28a-4b8a-86c4-fbe7214ddc4a None admin] RBAC: Adding query filter params (interface=public, service_id=2469ee84e2ad4a889490824227a585be, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:25.018255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33d888-d28a-4b8a-86c4-fbe7214ddc4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:25.019615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33d888-d28a-4b8a-86c4-fbe7214ddc4a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:25.024371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 659/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 10 11:50:24 2022] GET /identity/v3/endpoints?service_id=2469ee84e2ad4a889490824227a585be&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:50:25.030758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:25.109289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:25.127318 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3757b4-34b7-4423-8f44-9f17dba99bcf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:25.159872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd8671-704a-4201-b9ba-95d53c5cd504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:25.160463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd8671-704a-4201-b9ba-95d53c5cd504 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:25.160745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd8671-704a-4201-b9ba-95d53c5cd504 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:25.161044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd8671-704a-4201-b9ba-95d53c5cd504 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:25.161646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd8671-704a-4201-b9ba-95d53c5cd504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:25.162981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd8671-704a-4201-b9ba-95d53c5cd504 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:25.169553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 642/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 10 11:50:25 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:50:27.272765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272823f-e7f9-4fee-8eca-09d20447ce5a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:27.273318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272823f-e7f9-4fee-8eca-09d20447ce5a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:27.273415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272823f-e7f9-4fee-8eca-09d20447ce5a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:27.274884 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 660/1302] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:50:27.280280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72ae2-9ddf-4a71-b0ea-e332d8e0cf6a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:27.280703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72ae2-9ddf-4a71-b0ea-e332d8e0cf6a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:27.280829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe72ae2-9ddf-4a71-b0ea-e332d8e0cf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:27.298930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9fe72ae2-9ddf-4a71-b0ea-e332d8e0cf6a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:50:27.300092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9fe72ae2-9ddf-4a71-b0ea-e332d8e0cf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:50:27.362511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 643/1303] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:50:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 10 11:50:27.634740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272823f-e7f9-4fee-8eca-09d20447ce5a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:27.726238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:27.733732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272823f-e7f9-4fee-8eca-09d20447ce5a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:27.765515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:27.766121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:27.766395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:27.766662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:27.767230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:27.768583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 10 11:50:27.777140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 10 11:50:27.778833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Oct 10 11:50:27.779897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 661/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 10 11:50:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 10 11:50:27.784762 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe72ae2-9ddf-4a71-b0ea-e332d8e0cf6a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:27.858706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:27.880787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe72ae2-9ddf-4a71-b0ea-e332d8e0cf6a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:27.913006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7188958-97e3-4c61-bedb-c4fdda89ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:27.913561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188958-97e3-4c61-bedb-c4fdda89ae7d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:27.913840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188958-97e3-4c61-bedb-c4fdda89ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:27.914113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7188958-97e3-4c61-bedb-c4fdda89ae7d None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:27.914724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7188958-97e3-4c61-bedb-c4fdda89ae7d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:50:27.915025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7188958-97e3-4c61-bedb-c4fdda89ae7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:27.916375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7188958-97e3-4c61-bedb-c4fdda89ae7d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:27.921881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 644/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Oct 10 11:50:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:50:27.927590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:50:28.022851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44705af6-f94b-440a-9811-3c8ba1ad5b51 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:50:28.055048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acf16f-18f4-415e-a455-ac609ac662cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:50:28.055633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acf16f-18f4-415e-a455-ac609ac662cb None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:50:28.055912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acf16f-18f4-415e-a455-ac609ac662cb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:50:28.056180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acf16f-18f4-415e-a455-ac609ac662cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:50:28.056838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acf16f-18f4-415e-a455-ac609ac662cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:50:28.058215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acf16f-18f4-415e-a455-ac609ac662cb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:50:28.077168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 662/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:50:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:50:37.918542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=30 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:50:38.072497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:31.490868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de990e0c-90e2-4255-86ec-d1d4dae28529 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:31.491483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de990e0c-90e2-4255-86ec-d1d4dae28529 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:31.491675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de990e0c-90e2-4255-86ec-d1d4dae28529 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:31.493262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 645/1307] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:51:31.499257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad911-6a09-4002-b209-77516d914ca0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:31.499729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad911-6a09-4002-b209-77516d914ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:31.499810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad911-6a09-4002-b209-77516d914ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:31.574548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f3dad911-6a09-4002-b209-77516d914ca0 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:31.575821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f3dad911-6a09-4002-b209-77516d914ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:31.679565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 663/1308] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:31.977069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fa9db-aeb5-49a0-8be2-905470768b8c None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:31.977419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fa9db-aeb5-49a0-8be2-905470768b8c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:31.977630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fa9db-aeb5-49a0-8be2-905470768b8c None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:31.979292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 646/1309] 10.222.0.45 () {54 vars in 964 bytes} [Mon Oct 10 11:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:31.984895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a388-87ff-4e36-a609-67311c923c96 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:31.985337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a388-87ff-4e36-a609-67311c923c96 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:31.985722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a388-87ff-4e36-a609-67311c923c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:32.065683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6661a388-87ff-4e36-a609-67311c923c96 None None] MFA Rules not processed for user `3a1f548368994994a2966b7818e8b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:32.067091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6661a388-87ff-4e36-a609-67311c923c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:32.089012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:32.148428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 664/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Mon Oct 10 11:51:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:32.157988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fa9db-aeb5-49a0-8be2-905470768b8c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:32.159884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f73fa9db-aeb5-49a0-8be2-905470768b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:32.274380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fa9db-aeb5-49a0-8be2-905470768b8c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:32.355871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e665f-515a-4088-a4d7-0fc979dabfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:32.356675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e665f-515a-4088-a4d7-0fc979dabfed service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:32.357145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e665f-515a-4088-a4d7-0fc979dabfed service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:32.357658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e665f-515a-4088-a4d7-0fc979dabfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:32.360063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-028e665f-515a-4088-a4d7-0fc979dabfed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:32.424302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:32.489634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e665f-515a-4088-a4d7-0fc979dabfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:32.491063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e665f-515a-4088-a4d7-0fc979dabfed service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:32.511994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 647/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:51:35.015201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d532-b24b-4810-8a7c-f637ef3892f4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:35.015765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d532-b24b-4810-8a7c-f637ef3892f4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:35.015765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d532-b24b-4810-8a7c-f637ef3892f4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:35.017013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 665/1312] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:35.022120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcc7a2-9fb0-4d99-809d-2d66e796babd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:35.022522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcc7a2-9fb0-4d99-809d-2d66e796babd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:35.022663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcc7a2-9fb0-4d99-809d-2d66e796babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:35.102724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-62dcc7a2-9fb0-4d99-809d-2d66e796babd None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:35.103952 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-62dcc7a2-9fb0-4d99-809d-2d66e796babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:35.196628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 648/1313] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:35.481981 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9d532-b24b-4810-8a7c-f637ef3892f4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:35.484071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0ec9d532-b24b-4810-8a7c-f637ef3892f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:35.583739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9d532-b24b-4810-8a7c-f637ef3892f4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:35.652345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:35.655062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe474f-db7b-4738-935f-aae7287ee21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:35.655874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe474f-db7b-4738-935f-aae7287ee21b service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:35.656384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe474f-db7b-4738-935f-aae7287ee21b service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:35.656853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe474f-db7b-4738-935f-aae7287ee21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:35.658520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d4fe474f-db7b-4738-935f-aae7287ee21b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:35.763856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe474f-db7b-4738-935f-aae7287ee21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:35.765733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe474f-db7b-4738-935f-aae7287ee21b service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:35.784038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 666/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:51:38.221315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc72ae-3b3e-4161-8df0-0c474cc38cbe None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:38.221834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc72ae-3b3e-4161-8df0-0c474cc38cbe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:38.221834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc72ae-3b3e-4161-8df0-0c474cc38cbe None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:38.223125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 649/1315] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:38.228391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7adb06-003c-4fde-ba4d-0ae9f7a16458 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:38.228834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7adb06-003c-4fde-ba4d-0ae9f7a16458 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:38.228946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7adb06-003c-4fde-ba4d-0ae9f7a16458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:38.293500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4c7adb06-003c-4fde-ba4d-0ae9f7a16458 None None] MFA Rules not processed for user `f259ec9489364c74a1ba8b68ff8cdbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:38.294688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4c7adb06-003c-4fde-ba4d-0ae9f7a16458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:38.346100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:38.390834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 667/1316] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:38.672592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc72ae-3b3e-4161-8df0-0c474cc38cbe None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:38.674199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-41bc72ae-3b3e-4161-8df0-0c474cc38cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:38.686226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:38.776766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc72ae-3b3e-4161-8df0-0c474cc38cbe None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:38.850255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38153b6-c2fc-4e99-91fd-9bc74b06a5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:38.850853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38153b6-c2fc-4e99-91fd-9bc74b06a5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:38.851129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38153b6-c2fc-4e99-91fd-9bc74b06a5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:38.851396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38153b6-c2fc-4e99-91fd-9bc74b06a5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:38.852998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b38153b6-c2fc-4e99-91fd-9bc74b06a5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:38.914162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:38.960017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38153b6-c2fc-4e99-91fd-9bc74b06a5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:38.961476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38153b6-c2fc-4e99-91fd-9bc74b06a5e3 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:38.979287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 650/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:51:41.644893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c76e-6466-4bf0-8ac5-3d1b48cfd0d4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:41.645480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c76e-6466-4bf0-8ac5-3d1b48cfd0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:41.645480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c76e-6466-4bf0-8ac5-3d1b48cfd0d4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:41.646799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 668/1318] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:41.652037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb23-6a0b-4b63-b7d0-774bd938b7b6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:41.652428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb23-6a0b-4b63-b7d0-774bd938b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:41.652586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bb23-6a0b-4b63-b7d0-774bd938b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:41.716665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bf51bb23-6a0b-4b63-b7d0-774bd938b7b6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:41.718514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bf51bb23-6a0b-4b63-b7d0-774bd938b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:41.812401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 651/1319] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:42.112348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0465b-b6c4-4b24-85e4-7c7ae52486dd None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.112626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0465b-b6c4-4b24-85e4-7c7ae52486dd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.112896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0465b-b6c4-4b24-85e4-7c7ae52486dd None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.114264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 669/1320] 10.222.0.45 () {54 vars in 964 bytes} [Mon Oct 10 11:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:42.120036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7cf02-f689-4242-a034-40eaab04d552 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.120326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7cf02-f689-4242-a034-40eaab04d552 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.120601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7cf02-f689-4242-a034-40eaab04d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.144582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:42.197020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-64a7cf02-f689-4242-a034-40eaab04d552 None None] MFA Rules not processed for user `3a1f548368994994a2966b7818e8b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:42.198230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-64a7cf02-f689-4242-a034-40eaab04d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:42.272346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 652/1321] 10.222.0.45 () {58 vars in 1061 bytes} [Mon Oct 10 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:42.281836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0465b-b6c4-4b24-85e4-7c7ae52486dd None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:42.283338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d4b0465b-b6c4-4b24-85e4-7c7ae52486dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:42.382888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0465b-b6c4-4b24-85e4-7c7ae52486dd None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:42.454587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668925-b316-47bb-b066-363d34966a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:42.455183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668925-b316-47bb-b066-363d34966a80 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:42.455459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668925-b316-47bb-b066-363d34966a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:42.455727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668925-b316-47bb-b066-363d34966a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:42.457330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c4668925-b316-47bb-b066-363d34966a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:42.463959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:42.564381 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4668925-b316-47bb-b066-363d34966a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:42.565894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4668925-b316-47bb-b066-363d34966a80 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:42.583554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 670/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:51:45.803449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1272e-6729-4adb-b356-4d2a6b95d8ba None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:45.804039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1272e-6729-4adb-b356-4d2a6b95d8ba None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:45.804039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1272e-6729-4adb-b356-4d2a6b95d8ba None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:45.805540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 653/1323] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:45.811879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c629e0-a792-460d-b109-0c3db22db5c0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:45.812309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c629e0-a792-460d-b109-0c3db22db5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:45.812425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c629e0-a792-460d-b109-0c3db22db5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:45.885344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d3c629e0-a792-460d-b109-0c3db22db5c0 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:45.886571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d3c629e0-a792-460d-b109-0c3db22db5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:45.949324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:45.993079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 671/1324] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:46.275833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1272e-6729-4adb-b356-4d2a6b95d8ba None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:46.277507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f1a1272e-6729-4adb-b356-4d2a6b95d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:46.380791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1272e-6729-4adb-b356-4d2a6b95d8ba None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:46.393772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:46.456096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3c483-10f5-4cd1-afa7-4ea989480f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:46.456702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3c483-10f5-4cd1-afa7-4ea989480f1d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:46.456995 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3c483-10f5-4cd1-afa7-4ea989480f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:46.457285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3c483-10f5-4cd1-afa7-4ea989480f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:46.458875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d9d3c483-10f5-4cd1-afa7-4ea989480f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:46.570564 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3c483-10f5-4cd1-afa7-4ea989480f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:46.572060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3c483-10f5-4cd1-afa7-4ea989480f1d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:46.591515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 654/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:51:48.805870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e32e-8119-4b9b-b51d-ebe51bf5a6b5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:48.805870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e32e-8119-4b9b-b51d-ebe51bf5a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:48.805870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3e32e-8119-4b9b-b51d-ebe51bf5a6b5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:48.805870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 672/1326] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:48.811331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427e6e5-feb5-43d3-b8b8-cc64217d4a7a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:48.811331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427e6e5-feb5-43d3-b8b8-cc64217d4a7a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:48.812336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427e6e5-feb5-43d3-b8b8-cc64217d4a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:48.860050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:48.879453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a427e6e5-feb5-43d3-b8b8-cc64217d4a7a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:48.880911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a427e6e5-feb5-43d3-b8b8-cc64217d4a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:48.981403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 655/1327] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:49.266123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3e32e-8119-4b9b-b51d-ebe51bf5a6b5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:49.267651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f9e3e32e-8119-4b9b-b51d-ebe51bf5a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:49.371963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3e32e-8119-4b9b-b51d-ebe51bf5a6b5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:49.444355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9911657-5557-4fd5-bd1d-e2aa2fd63ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:49.444957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911657-5557-4fd5-bd1d-e2aa2fd63ffe service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:49.445262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911657-5557-4fd5-bd1d-e2aa2fd63ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:49.445529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911657-5557-4fd5-bd1d-e2aa2fd63ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:49.447110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c9911657-5557-4fd5-bd1d-e2aa2fd63ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:49.463734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:49.562270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9911657-5557-4fd5-bd1d-e2aa2fd63ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:49.563707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9911657-5557-4fd5-bd1d-e2aa2fd63ffe service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:49.581885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 673/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:51:51.760014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bbc3-e86b-42a2-8231-a75352e6071a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:51.760526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bbc3-e86b-42a2-8231-a75352e6071a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:51.760526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bbc3-e86b-42a2-8231-a75352e6071a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:51.762093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 656/1329] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:51.767079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ac08-77a8-4ae2-b377-234b3fc46dc4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:51.767477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ac08-77a8-4ae2-b377-234b3fc46dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:51.767629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ac08-77a8-4ae2-b377-234b3fc46dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:51.835921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-47a1ac08-77a8-4ae2-b377-234b3fc46dc4 None None] MFA Rules not processed for user `f259ec9489364c74a1ba8b68ff8cdbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:51.837130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-47a1ac08-77a8-4ae2-b377-234b3fc46dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:51.901163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:51.933889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 674/1330] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:52.212241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509bbc3-e86b-42a2-8231-a75352e6071a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:52.213827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9509bbc3-e86b-42a2-8231-a75352e6071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:52.321970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509bbc3-e86b-42a2-8231-a75352e6071a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:52.344629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:52.401877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0964fd-fc68-4973-b048-3ab07964db5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:52.402412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0964fd-fc68-4973-b048-3ab07964db5f service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:52.402693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0964fd-fc68-4973-b048-3ab07964db5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:52.402961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0964fd-fc68-4973-b048-3ab07964db5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:52.404541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0e0964fd-fc68-4973-b048-3ab07964db5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:52.511150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0964fd-fc68-4973-b048-3ab07964db5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:52.512582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0964fd-fc68-4973-b048-3ab07964db5f service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:52.531018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 657/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:51:54.945192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fc14e-a540-4ced-90ae-6c4499138a78 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:54.945723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fc14e-a540-4ced-90ae-6c4499138a78 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:54.945723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fc14e-a540-4ced-90ae-6c4499138a78 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:54.946970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 675/1332] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:54.952148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8a56c-7681-4d5d-93bf-5229ec7be327 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:54.953102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8a56c-7681-4d5d-93bf-5229ec7be327 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:54.953279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8a56c-7681-4d5d-93bf-5229ec7be327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:55.016377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:55.019128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e9a8a56c-7681-4d5d-93bf-5229ec7be327 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:55.020880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e9a8a56c-7681-4d5d-93bf-5229ec7be327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:55.114547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 658/1333] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:55.398713 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fc14e-a540-4ced-90ae-6c4499138a78 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:55.400249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a63fc14e-a540-4ced-90ae-6c4499138a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:55.500696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fc14e-a540-4ced-90ae-6c4499138a78 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:55.571273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086b788-dd8a-40f3-afd3-446001901a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:55.571864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086b788-dd8a-40f3-afd3-446001901a66 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:55.572138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086b788-dd8a-40f3-afd3-446001901a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:55.572404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086b788-dd8a-40f3-afd3-446001901a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:55.573989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2086b788-dd8a-40f3-afd3-446001901a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:55.600176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:55.681872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086b788-dd8a-40f3-afd3-446001901a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:55.683227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086b788-dd8a-40f3-afd3-446001901a66 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:55.701360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 676/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:51:57.877937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c719-400d-42f1-8454-5bdef2ed58eb None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:57.878470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c719-400d-42f1-8454-5bdef2ed58eb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:57.878470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1c719-400d-42f1-8454-5bdef2ed58eb None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:57.879821 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 659/1335] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:51:57.885328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab0ff-eb23-4870-be07-5bf9b8111795 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:57.885767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab0ff-eb23-4870-be07-5bf9b8111795 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:57.885875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab0ff-eb23-4870-be07-5bf9b8111795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:57.950492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-30bab0ff-eb23-4870-be07-5bf9b8111795 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:51:57.951681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-30bab0ff-eb23-4870-be07-5bf9b8111795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:58.026780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:58.048987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 677/1336] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:51:58.334016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1c719-400d-42f1-8454-5bdef2ed58eb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:51:58.335574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ade1c719-400d-42f1-8454-5bdef2ed58eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:58.436512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1c719-400d-42f1-8454-5bdef2ed58eb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:51:58.464966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:51:58.509386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c1b3f-1afa-4c41-8a56-6329c8fa6724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:51:58.509991 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1b3f-1afa-4c41-8a56-6329c8fa6724 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:51:58.510269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1b3f-1afa-4c41-8a56-6329c8fa6724 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:51:58.510539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c1b3f-1afa-4c41-8a56-6329c8fa6724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:51:58.512122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-497c1b3f-1afa-4c41-8a56-6329c8fa6724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:51:58.617145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c1b3f-1afa-4c41-8a56-6329c8fa6724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:51:58.618488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c1b3f-1afa-4c41-8a56-6329c8fa6724 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:51:58.636598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 660/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:01.089916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1f0f-83a5-4877-bb6e-1e1a0c04a6b6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:01.090458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1f0f-83a5-4877-bb6e-1e1a0c04a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:01.090458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1f0f-83a5-4877-bb6e-1e1a0c04a6b6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:01.091796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 678/1338] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:01.097137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69541-cdf2-4a99-8db5-2fb27860af11 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:01.097563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69541-cdf2-4a99-8db5-2fb27860af11 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:01.097701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69541-cdf2-4a99-8db5-2fb27860af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:01.164496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-15a69541-cdf2-4a99-8db5-2fb27860af11 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:01.165736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-15a69541-cdf2-4a99-8db5-2fb27860af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:01.174406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:01.263772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 661/1339] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:01.544662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1f0f-83a5-4877-bb6e-1e1a0c04a6b6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:01.546258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b9fb1f0f-83a5-4877-bb6e-1e1a0c04a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:01.647232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1f0f-83a5-4877-bb6e-1e1a0c04a6b6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:01.720788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc7e36-269c-40e1-8a3c-27f0b0dda5d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:01.721348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc7e36-269c-40e1-8a3c-27f0b0dda5d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:01.721632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc7e36-269c-40e1-8a3c-27f0b0dda5d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:01.721903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc7e36-269c-40e1-8a3c-27f0b0dda5d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:01.723472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-88bc7e36-269c-40e1-8a3c-27f0b0dda5d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:01.758371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:01.831046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc7e36-269c-40e1-8a3c-27f0b0dda5d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:01.832494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc7e36-269c-40e1-8a3c-27f0b0dda5d1 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:01.850537 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 679/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:06.012370 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720aa5-062c-4bdc-928e-a7431120ccc8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:06.012958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720aa5-062c-4bdc-928e-a7431120ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:06.012958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720aa5-062c-4bdc-928e-a7431120ccc8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:06.014293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 662/1341] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:06.019629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cee8-ec6e-4403-a186-d6cee4d5ea9a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:06.020059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cee8-ec6e-4403-a186-d6cee4d5ea9a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:06.020318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423cee8-ec6e-4403-a186-d6cee4d5ea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:06.085038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f423cee8-ec6e-4403-a186-d6cee4d5ea9a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:06.086161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f423cee8-ec6e-4403-a186-d6cee4d5ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:06.171746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:06.183279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 680/1342] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:06.471935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720aa5-062c-4bdc-928e-a7431120ccc8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:06.473489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-55720aa5-062c-4bdc-928e-a7431120ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:06.577886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720aa5-062c-4bdc-928e-a7431120ccc8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:06.616041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:06.653346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94488d5e-2586-4a09-bd34-850a7c0d937a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:06.653952 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94488d5e-2586-4a09-bd34-850a7c0d937a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:06.654226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94488d5e-2586-4a09-bd34-850a7c0d937a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:06.654487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94488d5e-2586-4a09-bd34-850a7c0d937a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:06.656057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-94488d5e-2586-4a09-bd34-850a7c0d937a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:06.763698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94488d5e-2586-4a09-bd34-850a7c0d937a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:06.765065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94488d5e-2586-4a09-bd34-850a7c0d937a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:06.783522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 663/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:09.534085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce310a6-e651-4e4d-a23a-8140d17ba5e5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:09.534637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce310a6-e651-4e4d-a23a-8140d17ba5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:09.534637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce310a6-e651-4e4d-a23a-8140d17ba5e5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:09.535950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 681/1344] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:09.541144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929065-da60-4f8a-8b76-69496d2d502e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:09.541597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929065-da60-4f8a-8b76-69496d2d502e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:09.541825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929065-da60-4f8a-8b76-69496d2d502e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:09.607767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a1929065-da60-4f8a-8b76-69496d2d502e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:09.608965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a1929065-da60-4f8a-8b76-69496d2d502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:09.633036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:09.712030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 664/1345] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:09.997258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce310a6-e651-4e4d-a23a-8140d17ba5e5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:09.998888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2ce310a6-e651-4e4d-a23a-8140d17ba5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:10.103989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce310a6-e651-4e4d-a23a-8140d17ba5e5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:10.183735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60707bb0-1d8b-46ee-9071-66b77737613c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:10.184336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707bb0-1d8b-46ee-9071-66b77737613c service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:10.184609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707bb0-1d8b-46ee-9071-66b77737613c service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:10.184877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707bb0-1d8b-46ee-9071-66b77737613c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:10.186495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-60707bb0-1d8b-46ee-9071-66b77737613c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:10.228682 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:10.294486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60707bb0-1d8b-46ee-9071-66b77737613c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:10.295922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60707bb0-1d8b-46ee-9071-66b77737613c service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:10.314893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 682/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:14.493323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cdbc3-8245-4830-97c0-fff6a3aa3a5f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:14.493789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cdbc3-8245-4830-97c0-fff6a3aa3a5f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:14.493885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cdbc3-8245-4830-97c0-fff6a3aa3a5f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:14.495408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 665/1347] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:14.500448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1ae7-045a-4969-bd24-2722569c87f2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:14.500854 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1ae7-045a-4969-bd24-2722569c87f2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:14.501054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1ae7-045a-4969-bd24-2722569c87f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:14.570093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3ead1ae7-045a-4969-bd24-2722569c87f2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:14.571304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3ead1ae7-045a-4969-bd24-2722569c87f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:14.669047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:14.671714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 683/1348] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:14.955622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cdbc3-8245-4830-97c0-fff6a3aa3a5f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:14.957234 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c27cdbc3-8245-4830-97c0-fff6a3aa3a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:15.059891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cdbc3-8245-4830-97c0-fff6a3aa3a5f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:15.105768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:15.131458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0142cf-305d-4017-b842-e7efce5efb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:15.131992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0142cf-305d-4017-b842-e7efce5efb8d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:15.132264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0142cf-305d-4017-b842-e7efce5efb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:15.132526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0142cf-305d-4017-b842-e7efce5efb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:15.134406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7b0142cf-305d-4017-b842-e7efce5efb8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:15.241646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0142cf-305d-4017-b842-e7efce5efb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:15.243070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0142cf-305d-4017-b842-e7efce5efb8d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:15.260890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 666/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:20.103478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967fbc-7b3e-42ef-9eee-a296f3992b87 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:20.103970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967fbc-7b3e-42ef-9eee-a296f3992b87 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:20.103970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967fbc-7b3e-42ef-9eee-a296f3992b87 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:20.105697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 684/1350] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 11:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:20.111203 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497d31-4f42-46d2-85e0-8a3a62d7fcbf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:20.111630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497d31-4f42-46d2-85e0-8a3a62d7fcbf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:20.111778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497d31-4f42-46d2-85e0-8a3a62d7fcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:20.231173 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5c497d31-4f42-46d2-85e0-8a3a62d7fcbf None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:20.232624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5c497d31-4f42-46d2-85e0-8a3a62d7fcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:20.266574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:20.385047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 667/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 11:52:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:24.524935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbae539-6e2f-4051-b757-05e31643c1cb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:24.525546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbae539-6e2f-4051-b757-05e31643c1cb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:24.525546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbae539-6e2f-4051-b757-05e31643c1cb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:24.527145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 685/1352] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 11:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:24.532265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91173-f36c-482a-8046-eb27fcfa8043 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:24.533722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91173-f36c-482a-8046-eb27fcfa8043 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:24.534106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91173-f36c-482a-8046-eb27fcfa8043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:24.614396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b9a91173-f36c-482a-8046-eb27fcfa8043 None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:24.615749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b9a91173-f36c-482a-8046-eb27fcfa8043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:24.690867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:24.728454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 668/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:26.004405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470905-c775-453d-9857-3614711ae8f1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:26.004900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470905-c775-453d-9857-3614711ae8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:26.004900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470905-c775-453d-9857-3614711ae8f1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:26.006404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 686/1354] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 11:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:26.011466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d47745-2077-40c5-b47b-c70d413e1e44 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:26.011876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d47745-2077-40c5-b47b-c70d413e1e44 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:26.012137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d47745-2077-40c5-b47b-c70d413e1e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:26.089832 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-10d47745-2077-40c5-b47b-c70d413e1e44 None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:26.091128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-10d47745-2077-40c5-b47b-c70d413e1e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:26.196487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 669/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 11:52:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:52:29.791274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8613-f66e-4ce6-96af-84593a3eb5b8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:29.791834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8613-f66e-4ce6-96af-84593a3eb5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:29.791834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a8613-f66e-4ce6-96af-84593a3eb5b8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:29.793321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 687/1356] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:29.798937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88012-63c4-479e-834e-726f14c10df4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:29.799393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88012-63c4-479e-834e-726f14c10df4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:29.799491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88012-63c4-479e-834e-726f14c10df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:29.845783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:29.881418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7dc88012-63c4-479e-834e-726f14c10df4 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:29.882605 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7dc88012-63c4-479e-834e-726f14c10df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:29.982690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 670/1357] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:30.302060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b48b-f515-43c3-b52e-61bf27a0d595 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:30.302349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b48b-f515-43c3-b52e-61bf27a0d595 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:30.302808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5b48b-f515-43c3-b52e-61bf27a0d595 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:30.304409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 688/1358] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 10 11:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:30.319501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df010d2-ae64-4e12-9a5e-e03d6ffd7a58 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:30.320241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df010d2-ae64-4e12-9a5e-e03d6ffd7a58 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:30.320804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df010d2-ae64-4e12-9a5e-e03d6ffd7a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:30.414311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8df010d2-ae64-4e12-9a5e-e03d6ffd7a58 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:30.415507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8df010d2-ae64-4e12-9a5e-e03d6ffd7a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:30.465864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:30.539463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 671/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 10 11:52:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:30.547569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5b48b-f515-43c3-b52e-61bf27a0d595 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:30.549743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c8c5b48b-f515-43c3-b52e-61bf27a0d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:30.709523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5b48b-f515-43c3-b52e-61bf27a0d595 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:30.787706 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:30.842224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa726dda-4b16-4be5-8111-9302ea70458c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:30.843199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa726dda-4b16-4be5-8111-9302ea70458c service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:30.843584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa726dda-4b16-4be5-8111-9302ea70458c service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:30.844045 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa726dda-4b16-4be5-8111-9302ea70458c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:30.846066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fa726dda-4b16-4be5-8111-9302ea70458c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:30.942465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa726dda-4b16-4be5-8111-9302ea70458c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:30.944244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa726dda-4b16-4be5-8111-9302ea70458c service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:30.963281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 689/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:33.338760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506596e-8d9c-40cd-915c-f777f135effb None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:33.339383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506596e-8d9c-40cd-915c-f777f135effb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:33.339383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506596e-8d9c-40cd-915c-f777f135effb None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:33.341008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 672/1361] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:33.346471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46967-58eb-40f9-9a95-7e725e9e0839 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:33.346935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46967-58eb-40f9-9a95-7e725e9e0839 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:33.347121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46967-58eb-40f9-9a95-7e725e9e0839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:33.416312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c3b46967-58eb-40f9-9a95-7e725e9e0839 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:33.417627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c3b46967-58eb-40f9-9a95-7e725e9e0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:33.456880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:33.525019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 690/1362] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:33.814408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506596e-8d9c-40cd-915c-f777f135effb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:33.819015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f506596e-8d9c-40cd-915c-f777f135effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:34.000133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506596e-8d9c-40cd-915c-f777f135effb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:34.011051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:34.143510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449777c-4080-41f0-8636-37259fe852b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:34.144130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449777c-4080-41f0-8636-37259fe852b9 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:34.144414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449777c-4080-41f0-8636-37259fe852b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:34.144686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449777c-4080-41f0-8636-37259fe852b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:34.146342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f449777c-4080-41f0-8636-37259fe852b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:34.236361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449777c-4080-41f0-8636-37259fe852b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:34.238085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449777c-4080-41f0-8636-37259fe852b9 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:34.257037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 673/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:36.746338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501d7d7-6456-464c-91e4-ec9c0a7c4ee6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:36.746946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501d7d7-6456-464c-91e4-ec9c0a7c4ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:36.747162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501d7d7-6456-464c-91e4-ec9c0a7c4ee6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:36.748614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 691/1364] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:36.754781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580a1b-2bad-474b-9bb0-14624c49c200 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:36.755221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580a1b-2bad-474b-9bb0-14624c49c200 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:36.755416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580a1b-2bad-474b-9bb0-14624c49c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:36.771943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:36.836349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4c580a1b-2bad-474b-9bb0-14624c49c200 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:36.837761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4c580a1b-2bad-474b-9bb0-14624c49c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:36.945577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 674/1365] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:37.244053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e81417-1406-4979-9f07-021358615b65 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:37.244452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e81417-1406-4979-9f07-021358615b65 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:37.244830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e81417-1406-4979-9f07-021358615b65 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:37.246423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 692/1366] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 10 11:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:37.252258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea6ef2-187c-469e-aeda-56a8ec8298d2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:37.252552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea6ef2-187c-469e-aeda-56a8ec8298d2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:37.252859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea6ef2-187c-469e-aeda-56a8ec8298d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:37.337622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-46ea6ef2-187c-469e-aeda-56a8ec8298d2 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:37.339064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-46ea6ef2-187c-469e-aeda-56a8ec8298d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:37.379160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:37.472098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 675/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 10 11:52:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:37.480357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e81417-1406-4979-9f07-021358615b65 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:37.481958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d6e81417-1406-4979-9f07-021358615b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:37.641549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e81417-1406-4979-9f07-021358615b65 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:37.663511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:37.774276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0aa1-2444-46eb-aa26-ff79f443d2cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:37.775257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0aa1-2444-46eb-aa26-ff79f443d2cc service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:37.775638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0aa1-2444-46eb-aa26-ff79f443d2cc service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:37.776185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0aa1-2444-46eb-aa26-ff79f443d2cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:37.778153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ce9a0aa1-2444-46eb-aa26-ff79f443d2cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:37.886960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690962-e707-46f3-98b9-51a270837cea None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:37.887512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690962-e707-46f3-98b9-51a270837cea None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:37.887512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690962-e707-46f3-98b9-51a270837cea None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:37.888067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a0aa1-2444-46eb-aa26-ff79f443d2cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:37.889013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 676/1368] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:52:37.889698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a0aa1-2444-46eb-aa26-ff79f443d2cc service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:37.894499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07976-9aa2-44a2-bb51-1d0146d2a43e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:37.894655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07976-9aa2-44a2-bb51-1d0146d2a43e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:37.894887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07976-9aa2-44a2-bb51-1d0146d2a43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:37.911775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 693/1369] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:37.964470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fae07976-9aa2-44a2-bb51-1d0146d2a43e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:37.965752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fae07976-9aa2-44a2-bb51-1d0146d2a43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:38.086745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:38.101357 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 677/1370] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:52:38.430832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc990-91c0-4f62-88f3-9ff9ce199f78 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:38.431123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc990-91c0-4f62-88f3-9ff9ce199f78 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:38.431399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bc990-91c0-4f62-88f3-9ff9ce199f78 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:38.433049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 694/1371] 10.222.0.45 () {54 vars in 963 bytes} [Mon Oct 10 11:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:38.438025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d29726-7739-47b5-9d23-d549a2e18820 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:38.438322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d29726-7739-47b5-9d23-d549a2e18820 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:38.438603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d29726-7739-47b5-9d23-d549a2e18820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:38.520436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-05d29726-7739-47b5-9d23-d549a2e18820 None None] MFA Rules not processed for user `bcb79c07e68446d19ac3aeb2279fd887`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:38.522080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-05d29726-7739-47b5-9d23-d549a2e18820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:38.605494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 678/1372] 10.222.0.45 () {58 vars in 1060 bytes} [Mon Oct 10 11:52:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:38.613056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bc990-91c0-4f62-88f3-9ff9ce199f78 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:38.614680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-541bc990-91c0-4f62-88f3-9ff9ce199f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:38.644446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:38.728722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bc990-91c0-4f62-88f3-9ff9ce199f78 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:38.820679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f406c-d745-4ec7-9d38-b1a20a02c9af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:38.821624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f406c-d745-4ec7-9d38-b1a20a02c9af service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:38.822032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f406c-d745-4ec7-9d38-b1a20a02c9af service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:38.822312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f406c-d745-4ec7-9d38-b1a20a02c9af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:38.823916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-da5f406c-d745-4ec7-9d38-b1a20a02c9af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:38.917208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:38.957130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f406c-d745-4ec7-9d38-b1a20a02c9af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:38.958628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f406c-d745-4ec7-9d38-b1a20a02c9af service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:38.978224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 695/1373] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:40.143263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451319-3507-43af-bd3f-53b708b13ea1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:40.143951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451319-3507-43af-bd3f-53b708b13ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:40.143951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451319-3507-43af-bd3f-53b708b13ea1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:40.145178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 679/1374] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:40.150371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408464e-baa7-470c-8bbc-91f71e8cf31e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:40.150832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408464e-baa7-470c-8bbc-91f71e8cf31e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:40.150929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408464e-baa7-470c-8bbc-91f71e8cf31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:40.217262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7408464e-baa7-470c-8bbc-91f71e8cf31e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:40.218464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7408464e-baa7-470c-8bbc-91f71e8cf31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:40.322456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 696/1375] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:40.614488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0451319-3507-43af-bd3f-53b708b13ea1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:40.616032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c0451319-3507-43af-bd3f-53b708b13ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:40.703935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:40.768674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0451319-3507-43af-bd3f-53b708b13ea1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:41.005226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fa8da-0bf6-40be-b4c7-d71f069fa04f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:41.005843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fa8da-0bf6-40be-b4c7-d71f069fa04f service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:41.006123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fa8da-0bf6-40be-b4c7-d71f069fa04f service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:41.006393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fa8da-0bf6-40be-b4c7-d71f069fa04f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:41.008025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3a1fa8da-0bf6-40be-b4c7-d71f069fa04f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:41.060947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:41.105130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fa8da-0bf6-40be-b4c7-d71f069fa04f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:41.106773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fa8da-0bf6-40be-b4c7-d71f069fa04f service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:41.126320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 680/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:43.337652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af587e-40d7-4f5a-a86b-85e125c9000a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:43.338187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af587e-40d7-4f5a-a86b-85e125c9000a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:43.338187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af587e-40d7-4f5a-a86b-85e125c9000a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:43.339696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 697/1377] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:43.344687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d4c7-6a23-433d-9168-adff3fb5e612 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:43.345119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d4c7-6a23-433d-9168-adff3fb5e612 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:43.345326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d4c7-6a23-433d-9168-adff3fb5e612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:43.413243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-46c2d4c7-6a23-433d-9168-adff3fb5e612 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:43.414440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-46c2d4c7-6a23-433d-9168-adff3fb5e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:43.513770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 681/1378] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:43.802667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af587e-40d7-4f5a-a86b-85e125c9000a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:43.806475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c6af587e-40d7-4f5a-a86b-85e125c9000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:43.846402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:43.960915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af587e-40d7-4f5a-a86b-85e125c9000a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:44.079683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:44.086215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af802dc7-940b-4d19-87c9-7be1ac14896d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:44.087178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af802dc7-940b-4d19-87c9-7be1ac14896d service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:44.087553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af802dc7-940b-4d19-87c9-7be1ac14896d service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:44.087949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af802dc7-940b-4d19-87c9-7be1ac14896d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:44.090630 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-af802dc7-940b-4d19-87c9-7be1ac14896d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:44.187437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af802dc7-940b-4d19-87c9-7be1ac14896d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:44.189151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af802dc7-940b-4d19-87c9-7be1ac14896d service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:44.207906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 698/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:46.411489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0eb05-336c-409f-aadb-97664ae20172 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:46.411913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0eb05-336c-409f-aadb-97664ae20172 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:46.412480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0eb05-336c-409f-aadb-97664ae20172 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:46.417156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 682/1380] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:46.421386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c8f3-92c5-4f89-ad63-f2e7625809c1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:46.421835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c8f3-92c5-4f89-ad63-f2e7625809c1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:46.421933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5c8f3-92c5-4f89-ad63-f2e7625809c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:46.501425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dee5c8f3-92c5-4f89-ad63-f2e7625809c1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:46.502649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dee5c8f3-92c5-4f89-ad63-f2e7625809c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:46.571565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:46.609919 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 699/1381] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:47.126860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0eb05-336c-409f-aadb-97664ae20172 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:47.129067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7ea0eb05-336c-409f-aadb-97664ae20172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:47.159774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:47.288838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0eb05-336c-409f-aadb-97664ae20172 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:47.401449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:47.431387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f2eab-ee8d-41c5-a6d7-22b1e3bbf697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:47.432425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f2eab-ee8d-41c5-a6d7-22b1e3bbf697 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:47.432951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f2eab-ee8d-41c5-a6d7-22b1e3bbf697 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:47.433412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f2eab-ee8d-41c5-a6d7-22b1e3bbf697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:47.436312 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b24f2eab-ee8d-41c5-a6d7-22b1e3bbf697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:47.548137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f2eab-ee8d-41c5-a6d7-22b1e3bbf697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:47.551802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f2eab-ee8d-41c5-a6d7-22b1e3bbf697 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:47.581998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 683/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:49.972224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbfe93-a63e-41d5-a6d3-2a8df9730883 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:49.972756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbfe93-a63e-41d5-a6d3-2a8df9730883 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:49.972856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbfe93-a63e-41d5-a6d3-2a8df9730883 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:49.974566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 700/1383] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:49.980848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fa0f9-30a9-4b15-babf-cd0cccd04571 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:49.981305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fa0f9-30a9-4b15-babf-cd0cccd04571 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:49.981435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fa0f9-30a9-4b15-babf-cd0cccd04571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:50.050587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cf5fa0f9-30a9-4b15-babf-cd0cccd04571 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:50.052132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf5fa0f9-30a9-4b15-babf-cd0cccd04571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:50.116518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:50.162346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 684/1384] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:50.443559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbfe93-a63e-41d5-a6d3-2a8df9730883 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:50.445136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1ecbfe93-a63e-41d5-a6d3-2a8df9730883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:50.596635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbfe93-a63e-41d5-a6d3-2a8df9730883 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:50.659395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:50.727064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1def1cc-b5d9-49f3-b0a8-75001d92439e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:50.727667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def1cc-b5d9-49f3-b0a8-75001d92439e service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:50.727946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def1cc-b5d9-49f3-b0a8-75001d92439e service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:50.728219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def1cc-b5d9-49f3-b0a8-75001d92439e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:50.729847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c1def1cc-b5d9-49f3-b0a8-75001d92439e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:50.827801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1def1cc-b5d9-49f3-b0a8-75001d92439e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:50.829443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1def1cc-b5d9-49f3-b0a8-75001d92439e service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:50.848324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 701/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:53.041451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9a55-7679-4eac-a251-ea14f9938d96 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:53.041992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9a55-7679-4eac-a251-ea14f9938d96 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:53.041992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9a55-7679-4eac-a251-ea14f9938d96 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:53.043357 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 685/1386] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:53.048631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c258-01ea-48fd-8821-45faf3dffd95 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:53.049046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c258-01ea-48fd-8821-45faf3dffd95 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:53.049365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1c258-01ea-48fd-8821-45faf3dffd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:53.118091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-baf1c258-01ea-48fd-8821-45faf3dffd95 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:53.119742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-baf1c258-01ea-48fd-8821-45faf3dffd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:53.129162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:53.218054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 702/1387] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:53.508425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9a55-7679-4eac-a251-ea14f9938d96 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:53.509981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1c6b9a55-7679-4eac-a251-ea14f9938d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:53.655434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9a55-7679-4eac-a251-ea14f9938d96 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:53.701420 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:53.768386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb8b35-cd34-4dbf-9157-fa45c384bb36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:53.769012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb8b35-cd34-4dbf-9157-fa45c384bb36 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:53.769292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb8b35-cd34-4dbf-9157-fa45c384bb36 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:53.769559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb8b35-cd34-4dbf-9157-fa45c384bb36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:53.771136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-37cb8b35-cd34-4dbf-9157-fa45c384bb36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:53.861071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb8b35-cd34-4dbf-9157-fa45c384bb36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:53.863384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb8b35-cd34-4dbf-9157-fa45c384bb36 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:53.881580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 686/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:54.158099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38120ad5-289c-4551-bf71-065045299ba6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:54.159187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38120ad5-289c-4551-bf71-065045299ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:54.159187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38120ad5-289c-4551-bf71-065045299ba6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:54.160487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 703/1389] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:54.165703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f69cf-3130-4c48-8e7f-c5ca28872c64 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:54.166114 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f69cf-3130-4c48-8e7f-c5ca28872c64 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:54.166282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f69cf-3130-4c48-8e7f-c5ca28872c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:54.229565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:54.232523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-454f69cf-3130-4c48-8e7f-c5ca28872c64 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:54.234346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-454f69cf-3130-4c48-8e7f-c5ca28872c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:54.328675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 687/1390] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:54.626975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033832-35c6-44e1-b987-fdb4fa992193 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:54.627832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033832-35c6-44e1-b987-fdb4fa992193 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:54.628176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033832-35c6-44e1-b987-fdb4fa992193 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:54.629647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 704/1391] 10.222.0.45 () {54 vars in 962 bytes} [Mon Oct 10 11:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:54.635033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc2f8-efcc-413f-9975-3ebb70c1473c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:54.635398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc2f8-efcc-413f-9975-3ebb70c1473c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:54.635780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cc2f8-efcc-413f-9975-3ebb70c1473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:54.713733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2b6cc2f8-efcc-413f-9975-3ebb70c1473c None None] MFA Rules not processed for user `4becd85ee7bb4920996dfe7b919aaa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:54.714919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2b6cc2f8-efcc-413f-9975-3ebb70c1473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:54.787788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:54.794570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 688/1392] 10.222.0.45 () {58 vars in 1059 bytes} [Mon Oct 10 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:54.803484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24033832-35c6-44e1-b987-fdb4fa992193 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:54.805019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-24033832-35c6-44e1-b987-fdb4fa992193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:54.912464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24033832-35c6-44e1-b987-fdb4fa992193 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:54.950550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:54.987371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945bffb-9dc7-4676-87be-d7c8c12f7288 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:54.987979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945bffb-9dc7-4676-87be-d7c8c12f7288 service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:54.988249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945bffb-9dc7-4676-87be-d7c8c12f7288 service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:54.988525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945bffb-9dc7-4676-87be-d7c8c12f7288 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:54.990138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b945bffb-9dc7-4676-87be-d7c8c12f7288 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:55.099242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945bffb-9dc7-4676-87be-d7c8c12f7288 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:55.100749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945bffb-9dc7-4676-87be-d7c8c12f7288 service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:55.121851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 705/1393] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:52:55.854233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8ed10-8c1a-47cc-b6cb-aa12664b3ce9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:55.854720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8ed10-8c1a-47cc-b6cb-aa12664b3ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:55.854828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8ed10-8c1a-47cc-b6cb-aa12664b3ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:55.925992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c8d8ed10-8c1a-47cc-b6cb-aa12664b3ce9 None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:55.927194 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c8d8ed10-8c1a-47cc-b6cb-aa12664b3ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:56.017992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 689/1394] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 11:52:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:52:56.056837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194601b-d6a5-4627-b0e4-25a4a2d8d0e7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:56.057307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194601b-d6a5-4627-b0e4-25a4a2d8d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:56.057398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194601b-d6a5-4627-b0e4-25a4a2d8d0e7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:56.058921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 706/1395] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:56.063482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b188-e8a4-4068-ae58-92783f5e26d9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:56.063777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b188-e8a4-4068-ae58-92783f5e26d9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:56.063879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a506f6-4f7d-43e5-a088-6b7515745b0b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:56.064054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15b188-e8a4-4068-ae58-92783f5e26d9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:56.064160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a506f6-4f7d-43e5-a088-6b7515745b0b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:56.064391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a506f6-4f7d-43e5-a088-6b7515745b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:56.065650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 690/1396] 10.222.0.45 () {54 vars in 943 bytes} [Mon Oct 10 11:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:56.075239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c784-8074-4ad2-9fbe-0c8eadcd8ba0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:56.075526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c784-8074-4ad2-9fbe-0c8eadcd8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:56.075804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c784-8074-4ad2-9fbe-0c8eadcd8ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:56.146591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f6a506f6-4f7d-43e5-a088-6b7515745b0b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:56.147862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f6a506f6-4f7d-43e5-a088-6b7515745b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:56.157082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c293c784-8074-4ad2-9fbe-0c8eadcd8ba0 None None] MFA Rules not processed for user `5aa9fe4b8abc4a35b5d4540c3c9e3aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:56.159372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c293c784-8074-4ad2-9fbe-0c8eadcd8ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:56.166911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:56.190716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:56.299075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 707/1397] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:52:56.323776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 691/1398] 10.222.0.45 () {58 vars in 1040 bytes} [Mon Oct 10 11:52:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:52:56.333046 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a506f6-4f7d-43e5-a088-6b7515745b0b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:56.334249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f6a506f6-4f7d-43e5-a088-6b7515745b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:56.436106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a506f6-4f7d-43e5-a088-6b7515745b0b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:56.483257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:56.541453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0766fd-c81d-4111-b01e-05bdc69ef2b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:56.542060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0766fd-c81d-4111-b01e-05bdc69ef2b8 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:56.542341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0766fd-c81d-4111-b01e-05bdc69ef2b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:56.542614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0766fd-c81d-4111-b01e-05bdc69ef2b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:56.544280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bd0766fd-c81d-4111-b01e-05bdc69ef2b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:56.596740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293c784-8074-4ad2-9fbe-0c8eadcd8ba0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:56.597996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c293c784-8074-4ad2-9fbe-0c8eadcd8ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:56.628867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0766fd-c81d-4111-b01e-05bdc69ef2b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:56.630513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0766fd-c81d-4111-b01e-05bdc69ef2b8 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:56.638632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 708/1399] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 11:52:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 11:52:56.701793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293c784-8074-4ad2-9fbe-0c8eadcd8ba0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:56.752619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:56.823447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37023d0a-59dd-4608-af81-c51fd58f5eab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:56.824063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37023d0a-59dd-4608-af81-c51fd58f5eab service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:56.824342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37023d0a-59dd-4608-af81-c51fd58f5eab service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:56.824614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37023d0a-59dd-4608-af81-c51fd58f5eab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:56.826267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-37023d0a-59dd-4608-af81-c51fd58f5eab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:56.923320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37023d0a-59dd-4608-af81-c51fd58f5eab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:52:56.924954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37023d0a-59dd-4608-af81-c51fd58f5eab service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:52:56.945114 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 692/1400] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 11:52:59.160956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa94a-b125-4c8e-a639-23e2ffe15ef1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:59.161555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa94a-b125-4c8e-a639-23e2ffe15ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:59.161555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa94a-b125-4c8e-a639-23e2ffe15ef1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:59.162892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 709/1401] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:52:59.168267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b921-b49e-43e5-8ee5-e6c7891abb47 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:59.168727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b921-b49e-43e5-8ee5-e6c7891abb47 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:59.172671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b921-b49e-43e5-8ee5-e6c7891abb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:59.247061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-85f5b921-b49e-43e5-8ee5-e6c7891abb47 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:52:59.248266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-85f5b921-b49e-43e5-8ee5-e6c7891abb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:59.251438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:59.365251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 693/1402] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:52:59.652252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fa94a-b125-4c8e-a639-23e2ffe15ef1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:52:59.653837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f84fa94a-b125-4c8e-a639-23e2ffe15ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:52:59.747161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:52:59.829595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fa94a-b125-4c8e-a639-23e2ffe15ef1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:52:59.954193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b31e3-ed55-4adf-8739-09bd9a2b96ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:52:59.955069 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b31e3-ed55-4adf-8739-09bd9a2b96ec service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:52:59.955356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b31e3-ed55-4adf-8739-09bd9a2b96ec service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:52:59.955643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b31e3-ed55-4adf-8739-09bd9a2b96ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:52:59.957800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-551b31e3-ed55-4adf-8739-09bd9a2b96ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:00.007052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:00.061623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b31e3-ed55-4adf-8739-09bd9a2b96ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:00.063582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b31e3-ed55-4adf-8739-09bd9a2b96ec service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:00.083589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 710/1403] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:02.313718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4069-58c4-4728-ae36-3994fef3c4ad None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:02.314346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4069-58c4-4728-ae36-3994fef3c4ad None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:02.314346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4069-58c4-4728-ae36-3994fef3c4ad None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:02.316334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 694/1404] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:02.321436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425dc7-245b-47ef-9163-e302e3137725 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:02.321864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425dc7-245b-47ef-9163-e302e3137725 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:02.321985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc425dc7-245b-47ef-9163-e302e3137725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:02.392228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cc425dc7-245b-47ef-9163-e302e3137725 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:02.394081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cc425dc7-245b-47ef-9163-e302e3137725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:02.502200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 711/1405] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:02.797916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f4069-58c4-4728-ae36-3994fef3c4ad None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:02.799469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-488f4069-58c4-4728-ae36-3994fef3c4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:02.972184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:02.993607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f4069-58c4-4728-ae36-3994fef3c4ad None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:03.132428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13735f4b-4032-4c64-86e0-16e8110f13b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:03.133208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735f4b-4032-4c64-86e0-16e8110f13b5 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:03.133487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735f4b-4032-4c64-86e0-16e8110f13b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:03.133754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13735f4b-4032-4c64-86e0-16e8110f13b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:03.135422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-13735f4b-4032-4c64-86e0-16e8110f13b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:03.243778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13735f4b-4032-4c64-86e0-16e8110f13b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:03.245374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13735f4b-4032-4c64-86e0-16e8110f13b5 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:03.256417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:03.267198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 695/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:05.472801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a9b6-34ae-4a4c-8e72-69d2cea6a6f8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:05.473393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a9b6-34ae-4a4c-8e72-69d2cea6a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:05.473393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a9b6-34ae-4a4c-8e72-69d2cea6a6f8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:05.474710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 712/1407] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:05.480694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aabec-61f0-4f71-9784-631e0c6ac692 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:05.481135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aabec-61f0-4f71-9784-631e0c6ac692 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:05.481304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aabec-61f0-4f71-9784-631e0c6ac692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:05.558413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b06aabec-61f0-4f71-9784-631e0c6ac692 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:05.559670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b06aabec-61f0-4f71-9784-631e0c6ac692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:05.665852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 696/1408] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:06.023893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7a9b6-34ae-4a4c-8e72-69d2cea6a6f8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:06.025468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a5d7a9b6-34ae-4a4c-8e72-69d2cea6a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:06.045126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:06.183547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7a9b6-34ae-4a4c-8e72-69d2cea6a6f8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:06.285054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:06.309529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615836d-cd01-4b5c-baff-fbbb627ca8b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:06.310141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615836d-cd01-4b5c-baff-fbbb627ca8b3 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:06.310532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615836d-cd01-4b5c-baff-fbbb627ca8b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:06.310813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615836d-cd01-4b5c-baff-fbbb627ca8b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:06.312429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f615836d-cd01-4b5c-baff-fbbb627ca8b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:06.408901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615836d-cd01-4b5c-baff-fbbb627ca8b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:06.410673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615836d-cd01-4b5c-baff-fbbb627ca8b3 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:06.430794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 713/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:15.664394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=68 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:16.428558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=54 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:19.242804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fca2e-2e67-42b7-9b3f-3caab2171351 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:19.243365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fca2e-2e67-42b7-9b3f-3caab2171351 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:19.243365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fca2e-2e67-42b7-9b3f-3caab2171351 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:19.244673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 697/1410] 10.222.0.45 () {54 vars in 918 bytes} [Mon Oct 10 11:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:19.249825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d03a0-514e-4b63-aa17-5aae4e4bf8e6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:19.250268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d03a0-514e-4b63-aa17-5aae4e4bf8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:19.250373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d03a0-514e-4b63-aa17-5aae4e4bf8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:19.325202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d60d03a0-514e-4b63-aa17-5aae4e4bf8e6 None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:19.326398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d60d03a0-514e-4b63-aa17-5aae4e4bf8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:19.431343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 714/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Oct 10 11:53:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:19.446063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc69b4-86e8-4292-ac32-880e57830c12 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:19.446342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc69b4-86e8-4292-ac32-880e57830c12 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:19.446613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc69b4-86e8-4292-ac32-880e57830c12 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:19.447920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 698/1412] 10.222.0.45 () {54 vars in 918 bytes} [Mon Oct 10 11:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:19.452521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f622-f0f3-493d-998b-903c58f368e9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:19.452801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f622-f0f3-493d-998b-903c58f368e9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:19.453101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9f622-f0f3-493d-998b-903c58f368e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:19.524245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:19.527452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cce9f622-f0f3-493d-998b-903c58f368e9 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:19.529338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cce9f622-f0f3-493d-998b-903c58f368e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:19.642250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 715/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Oct 10 11:53:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:22.192412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b5fc-7fa7-479b-8239-b96f1ace50df None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:22.192956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b5fc-7fa7-479b-8239-b96f1ace50df None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:22.192956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699b5fc-7fa7-479b-8239-b96f1ace50df None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:22.194234 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:22.199484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec96a-1bdd-4fb0-aec5-188fa60e8ebb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:22.199907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec96a-1bdd-4fb0-aec5-188fa60e8ebb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:22.200039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec96a-1bdd-4fb0-aec5-188fa60e8ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:22.265499 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fb8ec96a-1bdd-4fb0-aec5-188fa60e8ebb None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:22.266691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fb8ec96a-1bdd-4fb0-aec5-188fa60e8ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:22.320758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:22.362324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:22.649224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699b5fc-7fa7-479b-8239-b96f1ace50df None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:22.650791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c699b5fc-7fa7-479b-8239-b96f1ace50df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:22.792584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699b5fc-7fa7-479b-8239-b96f1ace50df None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:22.865484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:22.905442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f318b-5008-4fbe-b4da-9fd732ac24d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:22.905982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f318b-5008-4fbe-b4da-9fd732ac24d5 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:22.906260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f318b-5008-4fbe-b4da-9fd732ac24d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:22.906531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f318b-5008-4fbe-b4da-9fd732ac24d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:22.908119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe5f318b-5008-4fbe-b4da-9fd732ac24d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:22.997188 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f318b-5008-4fbe-b4da-9fd732ac24d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:22.998761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f318b-5008-4fbe-b4da-9fd732ac24d5 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:23.017137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 700/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:24.149211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398be56-76c2-4ec2-9e8a-6bc27bf25a16 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:24.149776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398be56-76c2-4ec2-9e8a-6bc27bf25a16 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:24.149776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398be56-76c2-4ec2-9e8a-6bc27bf25a16 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:24.150998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:24.157189 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed3d5-c941-4a5b-9a75-6be0cecffb98 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:24.157670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed3d5-c941-4a5b-9a75-6be0cecffb98 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:24.157780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed3d5-c941-4a5b-9a75-6be0cecffb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:24.233180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-405ed3d5-c941-4a5b-9a75-6be0cecffb98 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:24.234378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-405ed3d5-c941-4a5b-9a75-6be0cecffb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:24.260442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:24.329887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:24.477685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398be56-76c2-4ec2-9e8a-6bc27bf25a16 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:24.479120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c398be56-76c2-4ec2-9e8a-6bc27bf25a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:24.620398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398be56-76c2-4ec2-9e8a-6bc27bf25a16 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:24.659992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:24.731577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469bb83-2568-45a9-be65-c0e8726462c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:24.732120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bb83-2568-45a9-be65-c0e8726462c9 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:24.732393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bb83-2568-45a9-be65-c0e8726462c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:24.732659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bb83-2568-45a9-be65-c0e8726462c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:24.734288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8469bb83-2568-45a9-be65-c0e8726462c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:24.822711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469bb83-2568-45a9-be65-c0e8726462c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:24.824320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469bb83-2568-45a9-be65-c0e8726462c9 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:24.842640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 718/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:25.959889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb090-f3ff-4ba6-8302-e50733f09016 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:25.960496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb090-f3ff-4ba6-8302-e50733f09016 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:25.960496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb090-f3ff-4ba6-8302-e50733f09016 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:25.962049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:25.968097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377d26-e1ee-411c-b496-02eb6779dff8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:25.968502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377d26-e1ee-411c-b496-02eb6779dff8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:25.968636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377d26-e1ee-411c-b496-02eb6779dff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:26.023040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:26.044889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-39377d26-e1ee-411c-b496-02eb6779dff8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:26.046105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-39377d26-e1ee-411c-b496-02eb6779dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:26.139596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:26.288297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb090-f3ff-4ba6-8302-e50733f09016 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:26.289843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d4eeb090-f3ff-4ba6-8302-e50733f09016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:26.431969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb090-f3ff-4ba6-8302-e50733f09016 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:26.444123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:26.541065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9c92b-8c07-48e2-ab82-9296e3408813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:26.541667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c92b-8c07-48e2-ab82-9296e3408813 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:26.541940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c92b-8c07-48e2-ab82-9296e3408813 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:26.542204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9c92b-8c07-48e2-ab82-9296e3408813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:26.543772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5bf9c92b-8c07-48e2-ab82-9296e3408813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:26.630351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9c92b-8c07-48e2-ab82-9296e3408813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:26.631904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9c92b-8c07-48e2-ab82-9296e3408813 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:26.649473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 703/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:27.740792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe26b6-db74-4eb9-8117-c139e5eeabcb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:27.741404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe26b6-db74-4eb9-8117-c139e5eeabcb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:27.741404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe26b6-db74-4eb9-8117-c139e5eeabcb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:27.742724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:27.748763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd241d-3ccb-453a-be76-c7abacdd91b5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:27.749175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd241d-3ccb-453a-be76-c7abacdd91b5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:27.749339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd241d-3ccb-453a-be76-c7abacdd91b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:27.769433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:27.826316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-21fd241d-3ccb-453a-be76-c7abacdd91b5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:27.827521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-21fd241d-3ccb-453a-be76-c7abacdd91b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:27.922559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:28.072514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe26b6-db74-4eb9-8117-c139e5eeabcb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:28.074087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-89fe26b6-db74-4eb9-8117-c139e5eeabcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:28.181798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:28.217550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe26b6-db74-4eb9-8117-c139e5eeabcb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:28.328427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc1b65-b092-4082-bb25-3cc8f869e04c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:28.328959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1b65-b092-4082-bb25-3cc8f869e04c service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:28.329270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1b65-b092-4082-bb25-3cc8f869e04c service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:28.329541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1b65-b092-4082-bb25-3cc8f869e04c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:28.331127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a8cc1b65-b092-4082-bb25-3cc8f869e04c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:28.406690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:28.420562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc1b65-b092-4082-bb25-3cc8f869e04c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:28.422190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc1b65-b092-4082-bb25-3cc8f869e04c service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:28.440098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 721/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:29.535977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac611c-3254-49e9-a3d7-2bee12a84d34 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:29.536525 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac611c-3254-49e9-a3d7-2bee12a84d34 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:29.536525 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac611c-3254-49e9-a3d7-2bee12a84d34 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:29.537899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:29.543976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae8ef-5331-43ae-a9e8-35eeb83c9250 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:29.544431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae8ef-5331-43ae-a9e8-35eeb83c9250 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:29.544568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae8ef-5331-43ae-a9e8-35eeb83c9250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:29.619080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-83bae8ef-5331-43ae-a9e8-35eeb83c9250 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:29.620276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-83bae8ef-5331-43ae-a9e8-35eeb83c9250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:29.714750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:29.863496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac611c-3254-49e9-a3d7-2bee12a84d34 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:29.865666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-55ac611c-3254-49e9-a3d7-2bee12a84d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:29.947796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:30.008734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac611c-3254-49e9-a3d7-2bee12a84d34 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:30.119551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a029a-0e00-4b9b-a414-104b599dd3d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:30.120077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a029a-0e00-4b9b-a414-104b599dd3d7 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:30.120354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a029a-0e00-4b9b-a414-104b599dd3d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:30.120620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a029a-0e00-4b9b-a414-104b599dd3d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:30.122249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b90a029a-0e00-4b9b-a414-104b599dd3d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:30.170110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:30.210546 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a029a-0e00-4b9b-a414-104b599dd3d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:30.212129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a029a-0e00-4b9b-a414-104b599dd3d7 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:30.230391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 706/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:31.275609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e76f6-5379-4937-98d3-8c0be2e0597b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:31.276277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e76f6-5379-4937-98d3-8c0be2e0597b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:31.276277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e76f6-5379-4937-98d3-8c0be2e0597b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:31.277522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:31.283787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31bcb9-4436-4535-878c-85bd335349c9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:31.284209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31bcb9-4436-4535-878c-85bd335349c9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:31.284316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31bcb9-4436-4535-878c-85bd335349c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:31.359966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ae31bcb9-4436-4535-878c-85bd335349c9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:31.361217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ae31bcb9-4436-4535-878c-85bd335349c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:31.456894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:31.605048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e76f6-5379-4937-98d3-8c0be2e0597b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:31.606539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-819e76f6-5379-4937-98d3-8c0be2e0597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:31.655367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:31.750533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e76f6-5379-4937-98d3-8c0be2e0597b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:31.864089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6b0c-51bd-4f96-bae5-152ee6a74457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:31.864622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6b0c-51bd-4f96-bae5-152ee6a74457 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:31.864901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6b0c-51bd-4f96-bae5-152ee6a74457 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:31.865205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6b0c-51bd-4f96-bae5-152ee6a74457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:31.866813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8e1e6b0c-51bd-4f96-bae5-152ee6a74457 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:31.873619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:31.956200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e6b0c-51bd-4f96-bae5-152ee6a74457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:31.957855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e6b0c-51bd-4f96-bae5-152ee6a74457 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:31.975198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 724/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:33.023086 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164a58-82d8-4f77-becb-c8b22bb6f3fa None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:33.023581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164a58-82d8-4f77-becb-c8b22bb6f3fa None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:33.023692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164a58-82d8-4f77-becb-c8b22bb6f3fa None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:33.025052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:33.031389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb17c2-f6a5-4f6b-9fbb-1ddcd4d7a614 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:33.031843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb17c2-f6a5-4f6b-9fbb-1ddcd4d7a614 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:33.031959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb17c2-f6a5-4f6b-9fbb-1ddcd4d7a614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:33.107058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e0fb17c2-f6a5-4f6b-9fbb-1ddcd4d7a614 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:33.108235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e0fb17c2-f6a5-4f6b-9fbb-1ddcd4d7a614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:33.175563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:33.205863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:33.354352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164a58-82d8-4f77-becb-c8b22bb6f3fa None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:33.355857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e3164a58-82d8-4f77-becb-c8b22bb6f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:33.373410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:33.498211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164a58-82d8-4f77-becb-c8b22bb6f3fa None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:33.584213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:33.610361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b106d3-3df9-4600-aa16-7ed7ee6b14d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:33.610924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b106d3-3df9-4600-aa16-7ed7ee6b14d1 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:33.611226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b106d3-3df9-4600-aa16-7ed7ee6b14d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:33.611514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b106d3-3df9-4600-aa16-7ed7ee6b14d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:33.613142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-12b106d3-3df9-4600-aa16-7ed7ee6b14d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:33.699726 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b106d3-3df9-4600-aa16-7ed7ee6b14d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:33.701337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b106d3-3df9-4600-aa16-7ed7ee6b14d1 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:33.718528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 709/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:34.765362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05175e3-9e05-4e63-a8bd-3be166f2b62d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:34.765824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05175e3-9e05-4e63-a8bd-3be166f2b62d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:34.765927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05175e3-9e05-4e63-a8bd-3be166f2b62d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:34.767250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:34.773635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4734a-73cd-4467-8862-46ca8f12f633 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:34.774099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4734a-73cd-4467-8862-46ca8f12f633 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:34.774206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4734a-73cd-4467-8862-46ca8f12f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:34.850808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4cb4734a-73cd-4467-8862-46ca8f12f633 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:34.852009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4cb4734a-73cd-4467-8862-46ca8f12f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:34.892301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:34.946824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:35.098591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05175e3-9e05-4e63-a8bd-3be166f2b62d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:35.100133 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a05175e3-9e05-4e63-a8bd-3be166f2b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:35.243550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05175e3-9e05-4e63-a8bd-3be166f2b62d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:35.298123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:35.356693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f568b0-2f30-4236-ab2d-71bad17b5085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:35.357243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f568b0-2f30-4236-ab2d-71bad17b5085 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:35.357517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f568b0-2f30-4236-ab2d-71bad17b5085 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:35.357782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f568b0-2f30-4236-ab2d-71bad17b5085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:35.359355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b2f568b0-2f30-4236-ab2d-71bad17b5085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:35.446172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f568b0-2f30-4236-ab2d-71bad17b5085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:35.447764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f568b0-2f30-4236-ab2d-71bad17b5085 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:35.465025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 727/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:36.503320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3812-a4f9-4ee0-a2f5-fe347ba11c0d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:36.503902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3812-a4f9-4ee0-a2f5-fe347ba11c0d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:36.503902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a3812-a4f9-4ee0-a2f5-fe347ba11c0d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:36.505753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:36.511780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0834a5-c23e-4b4e-8ecb-c1e6f0cd0a4d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:36.512226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0834a5-c23e-4b4e-8ecb-c1e6f0cd0a4d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:36.512332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0834a5-c23e-4b4e-8ecb-c1e6f0cd0a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:36.586436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dd0834a5-c23e-4b4e-8ecb-c1e6f0cd0a4d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:36.587609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dd0834a5-c23e-4b4e-8ecb-c1e6f0cd0a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:36.589609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:36.680646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:36.828159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3812-a4f9-4ee0-a2f5-fe347ba11c0d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:36.829708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-119a3812-a4f9-4ee0-a2f5-fe347ba11c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:36.972623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a3812-a4f9-4ee0-a2f5-fe347ba11c0d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:36.999200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:37.083833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31372c3f-97a4-40e1-afb6-465521180e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:37.084359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372c3f-97a4-40e1-afb6-465521180e8c service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:37.084637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372c3f-97a4-40e1-afb6-465521180e8c service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:37.084907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372c3f-97a4-40e1-afb6-465521180e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:37.086528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-31372c3f-97a4-40e1-afb6-465521180e8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:37.175678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31372c3f-97a4-40e1-afb6-465521180e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:37.177806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31372c3f-97a4-40e1-afb6-465521180e8c service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:37.196035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 712/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:39.233471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accea70-0232-4bc0-994a-e94cf037b71a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:39.234065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accea70-0232-4bc0-994a-e94cf037b71a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:39.234065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accea70-0232-4bc0-994a-e94cf037b71a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:39.235340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:39.241135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3268-236f-43c2-b885-b91f74802d0e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:39.241581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3268-236f-43c2-b885-b91f74802d0e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:39.241687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3268-236f-43c2-b885-b91f74802d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:39.282214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:39.307396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-005f3268-236f-43c2-b885-b91f74802d0e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:39.308594 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-005f3268-236f-43c2-b885-b91f74802d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:39.402939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:39.689474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accea70-0232-4bc0-994a-e94cf037b71a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:39.691007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0accea70-0232-4bc0-994a-e94cf037b71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:39.792132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accea70-0232-4bc0-994a-e94cf037b71a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:39.824549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:39.868697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3d35e-3388-485e-b7df-3749b8854524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:39.869270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3d35e-3388-485e-b7df-3749b8854524 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:39.869549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3d35e-3388-485e-b7df-3749b8854524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:39.869817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3d35e-3388-485e-b7df-3749b8854524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:39.871413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-65e3d35e-3388-485e-b7df-3749b8854524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:39.979673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3d35e-3388-485e-b7df-3749b8854524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:39.981140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3d35e-3388-485e-b7df-3749b8854524 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:39.998852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 730/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:42.293587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ad9ad-26ce-4f3c-ab43-fa5746440f73 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:42.294142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ad9ad-26ce-4f3c-ab43-fa5746440f73 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:42.294142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ad9ad-26ce-4f3c-ab43-fa5746440f73 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:42.295506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:42.300820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16189-9ece-413b-8bcf-a85e6868c577 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:42.301280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16189-9ece-413b-8bcf-a85e6868c577 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:42.301433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc16189-9ece-413b-8bcf-a85e6868c577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:42.365214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7fc16189-9ece-413b-8bcf-a85e6868c577 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:42.366402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7fc16189-9ece-413b-8bcf-a85e6868c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:42.378585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:42.461341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:42.743380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ad9ad-26ce-4f3c-ab43-fa5746440f73 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:42.744953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2f6ad9ad-26ce-4f3c-ab43-fa5746440f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:42.847565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ad9ad-26ce-4f3c-ab43-fa5746440f73 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:42.860764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:42.921744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce234-9144-4688-87d0-fc85900f1c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:42.922348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce234-9144-4688-87d0-fc85900f1c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:42.922624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce234-9144-4688-87d0-fc85900f1c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:42.922896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce234-9144-4688-87d0-fc85900f1c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:42.924486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d70ce234-9144-4688-87d0-fc85900f1c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:43.034101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ce234-9144-4688-87d0-fc85900f1c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:43.035531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ce234-9144-4688-87d0-fc85900f1c1b service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:43.053745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 715/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:45.506003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9642068-c09c-402f-a417-925f4f6638c7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:45.506539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9642068-c09c-402f-a417-925f4f6638c7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:45.506539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9642068-c09c-402f-a417-925f4f6638c7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:45.508033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:45.513251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2afd8-b6c4-4e56-b963-0ba64f722dd7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:45.513626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2afd8-b6c4-4e56-b963-0ba64f722dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:45.513839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2afd8-b6c4-4e56-b963-0ba64f722dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:45.562859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:45.581454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d0d2afd8-b6c4-4e56-b963-0ba64f722dd7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:45.582652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d0d2afd8-b6c4-4e56-b963-0ba64f722dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:45.677198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:45.962571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9642068-c09c-402f-a417-925f4f6638c7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:45.964210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a9642068-c09c-402f-a417-925f4f6638c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:46.065636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9642068-c09c-402f-a417-925f4f6638c7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:46.105674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:46.140781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c59b6-770c-4da7-93bc-fc0f83779bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:46.141422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c59b6-770c-4da7-93bc-fc0f83779bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:46.141699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c59b6-770c-4da7-93bc-fc0f83779bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:46.141970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c59b6-770c-4da7-93bc-fc0f83779bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:46.143553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a5c59b6-770c-4da7-93bc-fc0f83779bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:46.250688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c59b6-770c-4da7-93bc-fc0f83779bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:46.252119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c59b6-770c-4da7-93bc-fc0f83779bf5 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:46.270398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 733/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:48.523306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3e75-f325-4aa9-b5e2-8a89572fc838 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:48.523847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3e75-f325-4aa9-b5e2-8a89572fc838 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:48.523847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3e75-f325-4aa9-b5e2-8a89572fc838 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:48.525219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:48.530440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281500-8780-4438-b743-2e64e105d503 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:48.530867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281500-8780-4438-b743-2e64e105d503 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:48.531015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281500-8780-4438-b743-2e64e105d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:48.595754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e4281500-8780-4438-b743-2e64e105d503 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:48.596936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e4281500-8780-4438-b743-2e64e105d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:48.617703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:48.691439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:48.973814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db3e75-f325-4aa9-b5e2-8a89572fc838 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:48.975898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-65db3e75-f325-4aa9-b5e2-8a89572fc838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:49.077567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db3e75-f325-4aa9-b5e2-8a89572fc838 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:49.097965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:49.155014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92328cc-4abf-4fbf-a1fc-e4e246ae4eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:49.155621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92328cc-4abf-4fbf-a1fc-e4e246ae4eec service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:49.155901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92328cc-4abf-4fbf-a1fc-e4e246ae4eec service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:49.156170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92328cc-4abf-4fbf-a1fc-e4e246ae4eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:49.157824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d92328cc-4abf-4fbf-a1fc-e4e246ae4eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:49.263757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92328cc-4abf-4fbf-a1fc-e4e246ae4eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:49.265481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92328cc-4abf-4fbf-a1fc-e4e246ae4eec service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:49.284425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 718/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:51.454375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80913-c346-48d7-ba8b-3230d4fb5310 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:51.454942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80913-c346-48d7-ba8b-3230d4fb5310 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:51.454942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af80913-c346-48d7-ba8b-3230d4fb5310 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:51.456268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:51.462176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a998e3-a651-40a1-95b2-a0341732ebc2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:51.462572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a998e3-a651-40a1-95b2-a0341732ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:51.462724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a998e3-a651-40a1-95b2-a0341732ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:51.528598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:51.531372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-11a998e3-a651-40a1-95b2-a0341732ebc2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:51.533243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-11a998e3-a651-40a1-95b2-a0341732ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:51.627301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:51.909762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af80913-c346-48d7-ba8b-3230d4fb5310 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:51.911315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6af80913-c346-48d7-ba8b-3230d4fb5310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:52.012400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af80913-c346-48d7-ba8b-3230d4fb5310 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:52.060608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:52.084931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d8edd-8cf3-4b09-bae3-e7c9f6690769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:52.085509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8edd-8cf3-4b09-bae3-e7c9f6690769 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:52.085787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8edd-8cf3-4b09-bae3-e7c9f6690769 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:52.086058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8edd-8cf3-4b09-bae3-e7c9f6690769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:52.087631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3b2d8edd-8cf3-4b09-bae3-e7c9f6690769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:52.194132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d8edd-8cf3-4b09-bae3-e7c9f6690769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:52.195553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d8edd-8cf3-4b09-bae3-e7c9f6690769 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:52.212904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 736/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:54.372921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9835-507e-4eb7-9783-2a28fe1b1e4b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:54.373509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9835-507e-4eb7-9783-2a28fe1b1e4b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:54.373509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9835-507e-4eb7-9783-2a28fe1b1e4b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:54.374852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:54.380014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7d06-e709-462b-81fa-20b5e87c1c8c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:54.380421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7d06-e709-462b-81fa-20b5e87c1c8c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:54.380561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7d06-e709-462b-81fa-20b5e87c1c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:54.445038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a64f7d06-e709-462b-81fa-20b5e87c1c8c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:54.446228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a64f7d06-e709-462b-81fa-20b5e87c1c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:54.473780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:54.540508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:54.824404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb9835-507e-4eb7-9783-2a28fe1b1e4b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:54.825997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0ddb9835-507e-4eb7-9783-2a28fe1b1e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:54.928013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb9835-507e-4eb7-9783-2a28fe1b1e4b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:54.955644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:55.000430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1f53-b99c-4c48-bdc4-937b7fa65c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:55.000964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1f53-b99c-4c48-bdc4-937b7fa65c4f service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:55.001275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1f53-b99c-4c48-bdc4-937b7fa65c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:55.001546 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1f53-b99c-4c48-bdc4-937b7fa65c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:55.003171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7f4b1f53-b99c-4c48-bdc4-937b7fa65c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:55.111043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1f53-b99c-4c48-bdc4-937b7fa65c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:55.112462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1f53-b99c-4c48-bdc4-937b7fa65c4f service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:55.130071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 721/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:53:57.292948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d65b4-138e-444b-98fb-8da5f30e3b49 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:57.293503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d65b4-138e-444b-98fb-8da5f30e3b49 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:57.293623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d65b4-138e-444b-98fb-8da5f30e3b49 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:57.294946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:53:57.300142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d02b-8a5c-42c4-aee5-5baa354f6718 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:57.300556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d02b-8a5c-42c4-aee5-5baa354f6718 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:57.300700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d02b-8a5c-42c4-aee5-5baa354f6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:57.366679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-24c8d02b-8a5c-42c4-aee5-5baa354f6718 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:53:57.367911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-24c8d02b-8a5c-42c4-aee5-5baa354f6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:57.376097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:57.465129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:53:57.747424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d65b4-138e-444b-98fb-8da5f30e3b49 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:53:57.748958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8d9d65b4-138e-444b-98fb-8da5f30e3b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:57.853415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d65b4-138e-444b-98fb-8da5f30e3b49 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:53:57.908156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:53:57.926158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aa31d-c3b2-4e1e-8a8c-8f0130d46b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:53:57.926758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa31d-c3b2-4e1e-8a8c-8f0130d46b83 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:53:57.927032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa31d-c3b2-4e1e-8a8c-8f0130d46b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:53:57.927300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa31d-c3b2-4e1e-8a8c-8f0130d46b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:53:57.929440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ad3aa31d-c3b2-4e1e-8a8c-8f0130d46b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:53:58.038565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aa31d-c3b2-4e1e-8a8c-8f0130d46b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:53:58.040019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aa31d-c3b2-4e1e-8a8c-8f0130d46b83 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:53:58.058720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 739/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:00.204936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3e90-3907-4efe-9cbc-cab483fd767d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:00.205489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3e90-3907-4efe-9cbc-cab483fd767d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:00.205489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b3e90-3907-4efe-9cbc-cab483fd767d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:00.206785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:00.212224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd21d11-4218-40b6-ab90-9ac4fed4c568 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:00.212627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd21d11-4218-40b6-ab90-9ac4fed4c568 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:00.212779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd21d11-4218-40b6-ab90-9ac4fed4c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:00.278554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9bd21d11-4218-40b6-ab90-9ac4fed4c568 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:00.279757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9bd21d11-4218-40b6-ab90-9ac4fed4c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:00.319508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:00.376653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:54:00.660731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b3e90-3907-4efe-9cbc-cab483fd767d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:00.662910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-287b3e90-3907-4efe-9cbc-cab483fd767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:00.764232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b3e90-3907-4efe-9cbc-cab483fd767d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:00.801762 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:00.838038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1dc62-c1d3-4225-bb7e-4585e5bf84b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:00.838644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1dc62-c1d3-4225-bb7e-4585e5bf84b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:00.838921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1dc62-c1d3-4225-bb7e-4585e5bf84b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:00.839190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1dc62-c1d3-4225-bb7e-4585e5bf84b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:00.840795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cbb1dc62-c1d3-4225-bb7e-4585e5bf84b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:00.947804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1dc62-c1d3-4225-bb7e-4585e5bf84b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:00.949184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1dc62-c1d3-4225-bb7e-4585e5bf84b8 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:00.967293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 724/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:03.117813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e22fa-719a-44f8-8b60-13ff09d9d1e5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:03.118436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e22fa-719a-44f8-8b60-13ff09d9d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:03.118436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e22fa-719a-44f8-8b60-13ff09d9d1e5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:03.119718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:03.125095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045dbd-1631-4f72-9394-4a803bd711d3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:03.126934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045dbd-1631-4f72-9394-4a803bd711d3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:03.127220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045dbd-1631-4f72-9394-4a803bd711d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:03.194556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-00045dbd-1631-4f72-9394-4a803bd711d3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:03.195762 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-00045dbd-1631-4f72-9394-4a803bd711d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:03.214040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:03.295317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:54:03.580422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e22fa-719a-44f8-8b60-13ff09d9d1e5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:03.582031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6e2e22fa-719a-44f8-8b60-13ff09d9d1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:03.684056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e22fa-719a-44f8-8b60-13ff09d9d1e5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:03.748615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:03.755609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdff27c-f3dc-4fa3-9aad-b088997bb308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:03.756339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff27c-f3dc-4fa3-9aad-b088997bb308 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:03.756624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff27c-f3dc-4fa3-9aad-b088997bb308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:03.756896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdff27c-f3dc-4fa3-9aad-b088997bb308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:03.758519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9bdff27c-f3dc-4fa3-9aad-b088997bb308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:03.866857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdff27c-f3dc-4fa3-9aad-b088997bb308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:03.868219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdff27c-f3dc-4fa3-9aad-b088997bb308 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:03.885879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 742/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:06.009491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00a9f6-4c2a-46b6-801c-6a4df742da86 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:06.010059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00a9f6-4c2a-46b6-801c-6a4df742da86 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:06.010059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00a9f6-4c2a-46b6-801c-6a4df742da86 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:06.011404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:06.017063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8ddc6-6470-49df-a679-0379700ed88a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:06.017501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8ddc6-6470-49df-a679-0379700ed88a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:06.017607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8ddc6-6470-49df-a679-0379700ed88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:06.081616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6ef8ddc6-6470-49df-a679-0379700ed88a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:06.082727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6ef8ddc6-6470-49df-a679-0379700ed88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:06.128525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:06.176959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:54:06.458255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00a9f6-4c2a-46b6-801c-6a4df742da86 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:06.459826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dc00a9f6-4c2a-46b6-801c-6a4df742da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:06.564500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00a9f6-4c2a-46b6-801c-6a4df742da86 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:06.610990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:06.637157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68836a45-adb0-4051-9c69-e584913ca7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:06.637764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836a45-adb0-4051-9c69-e584913ca7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:06.638045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836a45-adb0-4051-9c69-e584913ca7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:06.638319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836a45-adb0-4051-9c69-e584913ca7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:06.639910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-68836a45-adb0-4051-9c69-e584913ca7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:06.747814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68836a45-adb0-4051-9c69-e584913ca7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:06.749282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68836a45-adb0-4051-9c69-e584913ca7a0 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:06.767082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 727/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:16.175575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=22 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:16.764551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=66 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:26.676494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1227f8-bfc8-4268-8b7f-421380d2485e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:26.677096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1227f8-bfc8-4268-8b7f-421380d2485e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:26.677096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1227f8-bfc8-4268-8b7f-421380d2485e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:26.678421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 744/1471] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:26.683783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225294e4-ea96-40b8-8041-e86e3dd61a83 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:26.684228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225294e4-ea96-40b8-8041-e86e3dd61a83 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:26.684366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225294e4-ea96-40b8-8041-e86e3dd61a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:26.749501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-225294e4-ea96-40b8-8041-e86e3dd61a83 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:26.750707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-225294e4-ea96-40b8-8041-e86e3dd61a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:26.847135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 728/1472] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:54:27.148782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6caa-b14f-4ec8-99b9-be772a3394da None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:27.149096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6caa-b14f-4ec8-99b9-be772a3394da None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:27.149403 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6caa-b14f-4ec8-99b9-be772a3394da None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:27.150761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 745/1473] 10.222.0.45 () {54 vars in 962 bytes} [Mon Oct 10 11:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:27.155685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd461d-943a-4179-b9a1-6d7e38cc5c06 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:27.155969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd461d-943a-4179-b9a1-6d7e38cc5c06 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:27.156241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd461d-943a-4179-b9a1-6d7e38cc5c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:27.231085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ddbd461d-943a-4179-b9a1-6d7e38cc5c06 None None] MFA Rules not processed for user `4becd85ee7bb4920996dfe7b919aaa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:27.232281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ddbd461d-943a-4179-b9a1-6d7e38cc5c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:27.252706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:27.308237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 729/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Mon Oct 10 11:54:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:54:27.315830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c6caa-b14f-4ec8-99b9-be772a3394da None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:27.317398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bf4c6caa-b14f-4ec8-99b9-be772a3394da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:27.418850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c6caa-b14f-4ec8-99b9-be772a3394da None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:27.490040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8eaa6a-14e5-4ea4-8713-75ba0f2e5574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:27.490636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eaa6a-14e5-4ea4-8713-75ba0f2e5574 service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:27.490913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eaa6a-14e5-4ea4-8713-75ba0f2e5574 service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:27.491178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8eaa6a-14e5-4ea4-8713-75ba0f2e5574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:27.493316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8f8eaa6a-14e5-4ea4-8713-75ba0f2e5574 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:27.545978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:27.602811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eaa6a-14e5-4ea4-8713-75ba0f2e5574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:27.604346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8eaa6a-14e5-4ea4-8713-75ba0f2e5574 service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:27.739062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 746/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:29.957087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d8e9-6647-40fe-9dca-6a530c8419bd None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:29.957574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d8e9-6647-40fe-9dca-6a530c8419bd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:29.957574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d8e9-6647-40fe-9dca-6a530c8419bd None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:29.958890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 730/1476] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:54:29.964197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3ca4-eafe-4457-a8db-728099e664d8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:29.964582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3ca4-eafe-4457-a8db-728099e664d8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:29.964743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f3ca4-eafe-4457-a8db-728099e664d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:30.029266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bd7f3ca4-eafe-4457-a8db-728099e664d8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:30.030456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bd7f3ca4-eafe-4457-a8db-728099e664d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:30.122492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 747/1477] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:54:30.409462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9d8e9-6647-40fe-9dca-6a530c8419bd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:30.411057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-67a9d8e9-6647-40fe-9dca-6a530c8419bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:30.535107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9d8e9-6647-40fe-9dca-6a530c8419bd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:30.582482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:30.625372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae969a4-996b-484d-8721-badf85ecdab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:30.625972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae969a4-996b-484d-8721-badf85ecdab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:30.626247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae969a4-996b-484d-8721-badf85ecdab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:30.626514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae969a4-996b-484d-8721-badf85ecdab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:30.627142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae969a4-996b-484d-8721-badf85ecdab4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:30.628825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-cae969a4-996b-484d-8721-badf85ecdab4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:54:30.628825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Oct 10 11:54:30.628825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: Oct 10 11:54:30.629977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae969a4-996b-484d-8721-badf85ecdab4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:30.649643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 731/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 10 11:54:30 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:54:32.786238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d04c0-70cc-421d-9676-959c21cae802 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:32.786724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d04c0-70cc-421d-9676-959c21cae802 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:32.786912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d04c0-70cc-421d-9676-959c21cae802 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:32.788107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 748/1479] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:32.793335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f5cd-70c8-4707-92e4-a205729297ab None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:32.793767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f5cd-70c8-4707-92e4-a205729297ab None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:32.793914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f5cd-70c8-4707-92e4-a205729297ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:32.859915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-39b8f5cd-70c8-4707-92e4-a205729297ab None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:32.861159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-39b8f5cd-70c8-4707-92e4-a205729297ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:32.957268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 732/1480] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:54:33.250837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d04c0-70cc-421d-9676-959c21cae802 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:33.252436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-618d04c0-70cc-421d-9676-959c21cae802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:33.263454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:33.396354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d04c0-70cc-421d-9676-959c21cae802 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:33.475138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:33.509509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354961be-adc7-49d5-8b16-9f6c5deef65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:33.510108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354961be-adc7-49d5-8b16-9f6c5deef65a service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:33.510384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354961be-adc7-49d5-8b16-9f6c5deef65a service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:33.510648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354961be-adc7-49d5-8b16-9f6c5deef65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:33.512253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-354961be-adc7-49d5-8b16-9f6c5deef65a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:33.598549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354961be-adc7-49d5-8b16-9f6c5deef65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:33.600145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354961be-adc7-49d5-8b16-9f6c5deef65a service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:33.619981 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 749/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:35.917020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a659-ef97-4f2c-8037-b2165fec9db1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:35.917552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a659-ef97-4f2c-8037-b2165fec9db1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:35.917552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a659-ef97-4f2c-8037-b2165fec9db1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:35.918896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 733/1482] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:35.924255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d690d7-477a-49bf-bcac-ea856da4faa5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:35.924676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d690d7-477a-49bf-bcac-ea856da4faa5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:35.924832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d690d7-477a-49bf-bcac-ea856da4faa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:35.988788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d0d690d7-477a-49bf-bcac-ea856da4faa5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:35.990005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d0d690d7-477a-49bf-bcac-ea856da4faa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:36.034741 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:36.084759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 750/1483] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:54:36.369806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6a659-ef97-4f2c-8037-b2165fec9db1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:36.371341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7bc6a659-ef97-4f2c-8037-b2165fec9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:36.395291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:36.472619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6a659-ef97-4f2c-8037-b2165fec9db1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:36.547271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a2f0b-728a-43bd-a144-e729eeb92119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:36.547907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2f0b-728a-43bd-a144-e729eeb92119 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:36.548185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2f0b-728a-43bd-a144-e729eeb92119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:36.548457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a2f0b-728a-43bd-a144-e729eeb92119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:36.550168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-910a2f0b-728a-43bd-a144-e729eeb92119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:36.623214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:36.657091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a2f0b-728a-43bd-a144-e729eeb92119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:36.658509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a2f0b-728a-43bd-a144-e729eeb92119 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:36.676866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 734/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:38.865119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1621-24df-4c27-be16-32d39d766a96 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:38.865621 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1621-24df-4c27-be16-32d39d766a96 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:38.865739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1621-24df-4c27-be16-32d39d766a96 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:38.866995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 751/1485] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:38.872260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b57eb-eb03-415e-892d-cfa7fcb94565 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:38.872666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b57eb-eb03-415e-892d-cfa7fcb94565 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:38.872806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b57eb-eb03-415e-892d-cfa7fcb94565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:38.938146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fc0b57eb-eb03-415e-892d-cfa7fcb94565 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:38.939345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fc0b57eb-eb03-415e-892d-cfa7fcb94565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:39.035046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 735/1486] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:54:39.324390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1621-24df-4c27-be16-32d39d766a96 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:39.326244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aeea1621-24df-4c27-be16-32d39d766a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:39.426987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1621-24df-4c27-be16-32d39d766a96 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:39.498326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:39.499851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3371c7a-1310-427a-81cf-31f89e67ca37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:39.500428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371c7a-1310-427a-81cf-31f89e67ca37 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:39.500904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371c7a-1310-427a-81cf-31f89e67ca37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:39.501247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371c7a-1310-427a-81cf-31f89e67ca37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:39.503199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c3371c7a-1310-427a-81cf-31f89e67ca37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:39.609239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3371c7a-1310-427a-81cf-31f89e67ca37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:39.610596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3371c7a-1310-427a-81cf-31f89e67ca37 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:39.627768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 752/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:41.920789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b5fd-7c2a-4eb3-9a40-6cb870f54cfa None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:41.921417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b5fd-7c2a-4eb3-9a40-6cb870f54cfa None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:41.921417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634b5fd-7c2a-4eb3-9a40-6cb870f54cfa None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:41.922699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 736/1488] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:41.928013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cf8a-860e-45ad-b6a3-599fd9f95ee2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:41.928431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cf8a-860e-45ad-b6a3-599fd9f95ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:41.928534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04cf8a-860e-45ad-b6a3-599fd9f95ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:41.992455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-df04cf8a-860e-45ad-b6a3-599fd9f95ee2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:41.993670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-df04cf8a-860e-45ad-b6a3-599fd9f95ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:42.045081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:42.088861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 753/1489] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:54:42.373987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b5fd-7c2a-4eb3-9a40-6cb870f54cfa None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:42.375516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6634b5fd-7c2a-4eb3-9a40-6cb870f54cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:42.411431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:42.479220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634b5fd-7c2a-4eb3-9a40-6cb870f54cfa None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:42.552743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f95b0-0a58-46e1-aa03-7fa026b17d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:42.553376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f95b0-0a58-46e1-aa03-7fa026b17d31 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:42.553657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f95b0-0a58-46e1-aa03-7fa026b17d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:42.553926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f95b0-0a58-46e1-aa03-7fa026b17d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:42.555513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9b5f95b0-0a58-46e1-aa03-7fa026b17d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:42.633755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:42.663040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f95b0-0a58-46e1-aa03-7fa026b17d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:42.664495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f95b0-0a58-46e1-aa03-7fa026b17d31 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:42.681908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 737/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:45.059892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc942-f9b3-42e8-829c-38e5fe2fd24a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:45.060529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc942-f9b3-42e8-829c-38e5fe2fd24a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:45.060529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc942-f9b3-42e8-829c-38e5fe2fd24a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:45.061839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 754/1491] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 10 11:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:54:45.067031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4b273-e715-4052-9a60-6fe9f9b37738 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:45.067450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4b273-e715-4052-9a60-6fe9f9b37738 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:45.067584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4b273-e715-4052-9a60-6fe9f9b37738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:45.132519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-08c4b273-e715-4052-9a60-6fe9f9b37738 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:54:45.133780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-08c4b273-e715-4052-9a60-6fe9f9b37738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:45.229043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 738/1492] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 10 11:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:54:45.518595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc942-f9b3-42e8-829c-38e5fe2fd24a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:54:45.520471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5b4cc942-f9b3-42e8-829c-38e5fe2fd24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:45.621400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc942-f9b3-42e8-829c-38e5fe2fd24a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:54:45.692526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a69d4-bf48-4a45-a309-b82adeec3ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:54:45.693156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a69d4-bf48-4a45-a309-b82adeec3ccf service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:54:45.693435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a69d4-bf48-4a45-a309-b82adeec3ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:54:45.693704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a69d4-bf48-4a45-a309-b82adeec3ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:54:45.695285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e19a69d4-bf48-4a45-a309-b82adeec3ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:54:45.703718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:45.802090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a69d4-bf48-4a45-a309-b82adeec3ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:54:45.803721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a69d4-bf48-4a45-a309-b82adeec3ccf service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:54:45.821870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 755/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:54:55.228043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=82 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:54:55.819624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=50 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:57.744670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61785c0c-4561-47a4-b31c-e4ae1857644d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:57.745282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61785c0c-4561-47a4-b31c-e4ae1857644d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:57.745282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61785c0c-4561-47a4-b31c-e4ae1857644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:57.821291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-61785c0c-4561-47a4-b31c-e4ae1857644d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:55:57.822503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61785c0c-4561-47a4-b31c-e4ae1857644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:57.917802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 739/1494] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:55:57.926309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f9bf-354f-42d9-abba-38e641bbb1b8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:57.926788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f9bf-354f-42d9-abba-38e641bbb1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:57.926891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46f9bf-354f-42d9-abba-38e641bbb1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:58.001776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-df46f9bf-354f-42d9-abba-38e641bbb1b8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:55:58.002967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-df46f9bf-354f-42d9-abba-38e641bbb1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:58.098362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 756/1495] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:55:58.103069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61785c0c-4561-47a4-b31c-e4ae1857644d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:55:58.104268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61785c0c-4561-47a4-b31c-e4ae1857644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:58.116279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61785c0c-4561-47a4-b31c-e4ae1857644d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:55:58.177185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:58.209942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:55:58.210548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:58.210823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:58.211093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:58.211721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:55:58.212021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:55:58.213038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:55:58.213038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Oct 10 11:55:58.213038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: Oct 10 11:55:58.213917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:55:58.225259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 740/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:55:58.234041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46f9bf-354f-42d9-abba-38e641bbb1b8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:55:58.243056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46f9bf-354f-42d9-abba-38e641bbb1b8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:55:58.305049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:58.338203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:55:58.338801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:58.339073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:58.339339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:58.339966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:55:58.342317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:55:58.342317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Oct 10 11:55:58.342317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: Oct 10 11:55:58.343490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:55:58.397826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 757/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:55:58 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:55:58.402385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:55:58.404616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:58.437160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ebeb8-ba86-4f76-be2f-d01fe27d6fb3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:55:58.529391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:55:58.529994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:58.530265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:58.530527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:58.531152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:55:58.532148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:55:58.532148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Oct 10 11:55:58.532148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: Oct 10 11:55:58.533365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:55:58.574053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 741/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:55:58 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:55:58.578657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:55:58.580156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:58.641669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adf21e-2f71-4c84-9a50-c49f3558fa11 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:55:58.723287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:58.733830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:55:58.734430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:58.734705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:58.734975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:58.735608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:55:58.736620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:55:58.736620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Oct 10 11:55:58.736620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: Oct 10 11:55:58.737521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:55:58.749942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 758/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:55:58.753912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:55:58.755419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:58.767119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7a34-f107-4c8d-a9f0-4474ea958ec5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:55:58.792319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:58.864389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824c9b8-b0ee-4d63-a344-37ab6a578f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:55:58.864926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824c9b8-b0ee-4d63-a344-37ab6a578f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:58.865233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824c9b8-b0ee-4d63-a344-37ab6a578f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:58.865497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824c9b8-b0ee-4d63-a344-37ab6a578f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:58.866125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824c9b8-b0ee-4d63-a344-37ab6a578f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:55:58.867120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-d824c9b8-b0ee-4d63-a344-37ab6a578f10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:55:58.867120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Oct 10 11:55:58.867120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: Oct 10 11:55:58.868033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824c9b8-b0ee-4d63-a344-37ab6a578f10 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:55:58.880501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 742/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:55:58.884638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:55:58.886193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:58.919061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43290a1d-a75f-4514-b60e-bf6007f112f6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:55:59.009574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12431777-f17b-4e20-8757-54b835c9f9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:55:59.010224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431777-f17b-4e20-8757-54b835c9f9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:59.010503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431777-f17b-4e20-8757-54b835c9f9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:59.010774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12431777-f17b-4e20-8757-54b835c9f9c5 admin admin] PATH_INFO: `/v3/projects/3fba333614884fe3a3ca6dd88d4e52c5/users/dcd607588c2c463bb005cbfa7f10b0dd/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:59.033248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12431777-f17b-4e20-8757-54b835c9f9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fba333614884fe3a3ca6dd88d4e52c5, user_id=dcd607588c2c463bb005cbfa7f10b0dd, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:55:59.034274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-12431777-f17b-4e20-8757-54b835c9f9c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:55:59.034274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Oct 10 11:55:59.034274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: Oct 10 11:55:59.036179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12431777-f17b-4e20-8757-54b835c9f9c5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:55:59.060882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 759/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:55:58 2022] PUT /identity/v3/projects/3fba333614884fe3a3ca6dd88d4e52c5/users/dcd607588c2c463bb005cbfa7f10b0dd/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:55:59.072862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9021b-545b-4e92-8ef5-06b5af8ff0e4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:59.073186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9021b-545b-4e92-8ef5-06b5af8ff0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:59.073464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9021b-545b-4e92-8ef5-06b5af8ff0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:59.131003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-49f9021b-545b-4e92-8ef5-06b5af8ff0e4 None None] MFA Rules not processed for user `dcd607588c2c463bb005cbfa7f10b0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:55:59.132137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-49f9021b-545b-4e92-8ef5-06b5af8ff0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:59.207603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 743/1502] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:55:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:55:59.220807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11a40-3858-47a3-9d49-ad5df5aaf853 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:59.221103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11a40-3858-47a3-9d49-ad5df5aaf853 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:59.221429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a11a40-3858-47a3-9d49-ad5df5aaf853 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:59.222772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 760/1503] 10.222.0.45 () {54 vars in 963 bytes} [Mon Oct 10 11:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:55:59.227394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439929-f6b8-4638-9963-185335ed5e47 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:59.227796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439929-f6b8-4638-9963-185335ed5e47 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:59.228105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439929-f6b8-4638-9963-185335ed5e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:59.260384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:59.305124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0f439929-f6b8-4638-9963-185335ed5e47 None None] MFA Rules not processed for user `bcb79c07e68446d19ac3aeb2279fd887`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:55:59.306327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0f439929-f6b8-4638-9963-185335ed5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:59.385566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 744/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Mon Oct 10 11:55:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:55:59.393490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a11a40-3858-47a3-9d49-ad5df5aaf853 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:55:59.395030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-29a11a40-3858-47a3-9d49-ad5df5aaf853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:59.450838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:59.505066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a11a40-3858-47a3-9d49-ad5df5aaf853 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:55:59.576953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:55:59.577603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:59.577865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:59.578137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:59.579727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:59.677512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:55:59.678852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:55:59.682254 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:55:59.696485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 761/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:55:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:55:59.741250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e381-fe72-4ca8-9c90-5ee4414c13fc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:59.741538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e381-fe72-4ca8-9c90-5ee4414c13fc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:59.741860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e381-fe72-4ca8-9c90-5ee4414c13fc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:59.743128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 745/1506] 10.222.0.45 () {52 vars in 830 bytes} [Mon Oct 10 11:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:55:59.746563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:55:59.747758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:55:59.845580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5355a-a581-48d5-908b-19cc78f259b5 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:55:59.935424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:55:59.935971 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:55:59.936246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:55:59.936512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] PATH_INFO: `/v3/users/dcd607588c2c463bb005cbfa7f10b0dd` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:55:59.948914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd607588c2c463bb005cbfa7f10b0dd)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:55:59.950485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:55:59.950485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Oct 10 11:55:59.950485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: Oct 10 11:55:59.951675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:55:59.961027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:00.015240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd607588c2c463bb005cbfa7f10b0dd'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:00.038151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd607588c2c463bb005cbfa7f10b0dd'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:00.038606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd607588c2c463bb005cbfa7f10b0dd'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:00.047427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd607588c2c463bb005cbfa7f10b0dd'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:00.048001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd607588c2c463bb005cbfa7f10b0dd'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:00.066538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 762/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:55:59 2022] DELETE /identity/v3/users/dcd607588c2c463bb005cbfa7f10b0dd => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:56:00.070898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd7a7-2288-4e6a-9682-c16bd4fbf5d5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:56:00.071469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd7a7-2288-4e6a-9682-c16bd4fbf5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:56:00.071469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd7a7-2288-4e6a-9682-c16bd4fbf5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:56:00.129970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e91fd7a7-2288-4e6a-9682-c16bd4fbf5d5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:56:00.131223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e91fd7a7-2288-4e6a-9682-c16bd4fbf5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:56:00.205911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:00.218997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 746/1508] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:56:00.229224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:56:00.230439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:56:00.337926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b36f6-62f7-475c-800c-5c8b3d80eef5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:56:00.391722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:00.412357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d6680-e26b-4df6-b62d-438ccc8ed673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:56:00.412995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6680-e26b-4df6-b62d-438ccc8ed673 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:56:00.413280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6680-e26b-4df6-b62d-438ccc8ed673 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:56:00.413548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6680-e26b-4df6-b62d-438ccc8ed673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:56:00.415132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-037d6680-e26b-4df6-b62d-438ccc8ed673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:56:00.522498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d6680-e26b-4df6-b62d-438ccc8ed673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:56:00.524551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d6680-e26b-4df6-b62d-438ccc8ed673 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:56:00.542592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 763/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:56:00.886954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fd7a7-2288-4e6a-9682-c16bd4fbf5d5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:56:00.888840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e91fd7a7-2288-4e6a-9682-c16bd4fbf5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:56:00.900490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fd7a7-2288-4e6a-9682-c16bd4fbf5d5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:56:00.995915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:56:00.997102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:56:00.997385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:56:00.997653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] PATH_INFO: `/v3/projects/3fba333614884fe3a3ca6dd88d4e52c5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:56:01.007364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fba333614884fe3a3ca6dd88d4e52c5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:56:01.008393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:56:01.008393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Oct 10 11:56:01.008393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: Oct 10 11:56:01.009677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:56:01.067074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fba333614884fe3a3ca6dd88d4e52c5', 'request_id': 'req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:01.072867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fba333614884fe3a3ca6dd88d4e52c5', 'request_id': 'req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:01.086594 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fba333614884fe3a3ca6dd88d4e52c5', 'request_id': 'req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:01.111276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] The token cache is being invalidate because project 3fba333614884fe3a3ca6dd88d4e52c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:56:01.111565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:01.111987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c65acd5d-6c9e-4ca1-a707-3b8cf3d14a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:56:01.113402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 747/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:56:00 2022] DELETE /identity/v3/projects/3fba333614884fe3a3ca6dd88d4e52c5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:56:10.540414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=62 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:56:11.109433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:57:35.807736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d2d27-49bd-4f51-a918-fa4649cd2718 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:35.808347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d2d27-49bd-4f51-a918-fa4649cd2718 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:35.808448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d2d27-49bd-4f51-a918-fa4649cd2718 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:35.809963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:57:35.814927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b96b-fe7c-48c8-9009-7449c5e74ec9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:35.815348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b96b-fe7c-48c8-9009-7449c5e74ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:35.815476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b96b-fe7c-48c8-9009-7449c5e74ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:35.900820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d776b96b-fe7c-48c8-9009-7449c5e74ec9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:57:35.902064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d776b96b-fe7c-48c8-9009-7449c5e74ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:36.003802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:57:36.156812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d2d27-49bd-4f51-a918-fa4649cd2718 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:57:36.159205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aa4d2d27-49bd-4f51-a918-fa4649cd2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:36.275641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d2d27-49bd-4f51-a918-fa4649cd2718 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:57:36.281066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d41c79-0fe8-428a-9cc7-306f6388b4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:57:36.281670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d41c79-0fe8-428a-9cc7-306f6388b4d5 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:36.281947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d41c79-0fe8-428a-9cc7-306f6388b4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:36.282218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d41c79-0fe8-428a-9cc7-306f6388b4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:36.290395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d41c79-0fe8-428a-9cc7-306f6388b4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:57:36.291966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d41c79-0fe8-428a-9cc7-306f6388b4d5 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:57:36.301150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 765/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:57:37.301700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945eece-1867-4891-8a92-58bdaa3bc255 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:37.302356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945eece-1867-4891-8a92-58bdaa3bc255 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:37.302356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945eece-1867-4891-8a92-58bdaa3bc255 None None] PATH_INFO: `/v3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:37.304035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 749/1514] 10.222.0.36 () {54 vars in 925 bytes} [Mon Oct 10 11:57:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:57:37.310836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ca807-ef18-4bea-bff0-ba010692e3fc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:37.311311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ca807-ef18-4bea-bff0-ba010692e3fc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:37.311518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ca807-ef18-4bea-bff0-ba010692e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:37.378041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-059ca807-ef18-4bea-bff0-ba010692e3fc None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:57:37.379252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-059ca807-ef18-4bea-bff0-ba010692e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:37.399261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2337d-a613-450e-8d5b-4b3bed71b64e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:37.399541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2337d-a613-450e-8d5b-4b3bed71b64e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:37.399822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2337d-a613-450e-8d5b-4b3bed71b64e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:37.401222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 750/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:57:37.407235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebcc0-96ba-49ff-a7ba-d6cefcc6b3b7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:37.407514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebcc0-96ba-49ff-a7ba-d6cefcc6b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:37.407784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebcc0-96ba-49ff-a7ba-d6cefcc6b3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:37.429479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e3aebcc0-96ba-49ff-a7ba-d6cefcc6b3b7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:57:37.430665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e3aebcc0-96ba-49ff-a7ba-d6cefcc6b3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:37.438577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 751/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:57:37.450124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:57:37.455836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 766/1517] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Oct 10 11:57:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:57:37.591303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aebcc0-96ba-49ff-a7ba-d6cefcc6b3b7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:57:37.604079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aebcc0-96ba-49ff-a7ba-d6cefcc6b3b7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:57:37.609863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857e487-3ec4-4aa5-a408-b8001a4a8773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:57:37.610464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857e487-3ec4-4aa5-a408-b8001a4a8773 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:37.610744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857e487-3ec4-4aa5-a408-b8001a4a8773 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:37.611019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857e487-3ec4-4aa5-a408-b8001a4a8773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:37.619852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857e487-3ec4-4aa5-a408-b8001a4a8773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:57:37.621472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857e487-3ec4-4aa5-a408-b8001a4a8773 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:57:37.630866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 752/1518] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:57:46.691610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ffe14-3354-4463-8c28-73a035c744ad None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:46.692048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ffe14-3354-4463-8c28-73a035c744ad None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:46.692151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ffe14-3354-4463-8c28-73a035c744ad None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:46.693578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 767/1519] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 10 11:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:57:46.699735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bb94b-03e0-4baa-b2c3-3e61d788cf24 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:46.700200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bb94b-03e0-4baa-b2c3-3e61d788cf24 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:46.700303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bb94b-03e0-4baa-b2c3-3e61d788cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:46.719847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e06bb94b-03e0-4baa-b2c3-3e61d788cf24 None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:57:46.721064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e06bb94b-03e0-4baa-b2c3-3e61d788cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:46.729480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 753/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 10 11:57:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:57:46.736775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ffe14-3354-4463-8c28-73a035c744ad None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:57:46.749766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ffe14-3354-4463-8c28-73a035c744ad None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:57:46.754628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f06c03-1472-4c64-b836-e16d1cfdb138 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:57:46.755207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f06c03-1472-4c64-b836-e16d1cfdb138 service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:46.755483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f06c03-1472-4c64-b836-e16d1cfdb138 service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:46.755752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f06c03-1472-4c64-b836-e16d1cfdb138 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:46.764216 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f06c03-1472-4c64-b836-e16d1cfdb138 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:57:46.765822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f06c03-1472-4c64-b836-e16d1cfdb138 service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:57:46.776088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 768/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:57:49.085289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163fa7-8c4e-4d95-904c-1f82fbf25934 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:49.085845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163fa7-8c4e-4d95-904c-1f82fbf25934 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:49.085845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d163fa7-8c4e-4d95-904c-1f82fbf25934 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:49.087096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:57:49.093364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c12f9-6ce1-46f6-82f4-7c2c504f9741 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:49.093812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c12f9-6ce1-46f6-82f4-7c2c504f9741 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:49.093928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c12f9-6ce1-46f6-82f4-7c2c504f9741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:49.114008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4c4c12f9-6ce1-46f6-82f4-7c2c504f9741 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:57:49.115211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4c4c12f9-6ce1-46f6-82f4-7c2c504f9741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:49.123664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:57:49.277092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d163fa7-8c4e-4d95-904c-1f82fbf25934 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:57:49.292703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d163fa7-8c4e-4d95-904c-1f82fbf25934 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:57:49.298134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e1fd0-7da2-4cdc-bfc6-3a6b37dd7e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:57:49.298717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e1fd0-7da2-4cdc-bfc6-3a6b37dd7e51 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:49.298992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e1fd0-7da2-4cdc-bfc6-3a6b37dd7e51 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:49.299259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e1fd0-7da2-4cdc-bfc6-3a6b37dd7e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:49.307128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e1fd0-7da2-4cdc-bfc6-3a6b37dd7e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:57:49.308673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e1fd0-7da2-4cdc-bfc6-3a6b37dd7e51 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:57:49.317777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 755/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:57:50.379280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959098c7-e30a-4501-b4c9-cc7ba6347cd6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:50.379866 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959098c7-e30a-4501-b4c9-cc7ba6347cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:50.379866 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959098c7-e30a-4501-b4c9-cc7ba6347cd6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:50.381173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 10 11:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:57:50.387347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78b46-3e44-4c66-99b8-e5ef61bc1bf7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:50.387796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78b46-3e44-4c66-99b8-e5ef61bc1bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:50.387896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff78b46-3e44-4c66-99b8-e5ef61bc1bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:50.406845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1ff78b46-3e44-4c66-99b8-e5ef61bc1bf7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:57:50.408020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1ff78b46-3e44-4c66-99b8-e5ef61bc1bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:50.416580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 10 11:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:57:50.573441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959098c7-e30a-4501-b4c9-cc7ba6347cd6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:57:50.587655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959098c7-e30a-4501-b4c9-cc7ba6347cd6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:57:50.593063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa03be2-9df0-48c9-b0d7-4f670d98f38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:57:50.593659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03be2-9df0-48c9-b0d7-4f670d98f38a service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:50.593939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03be2-9df0-48c9-b0d7-4f670d98f38a service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:50.594238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03be2-9df0-48c9-b0d7-4f670d98f38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:50.602159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa03be2-9df0-48c9-b0d7-4f670d98f38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:57:50.604268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa03be2-9df0-48c9-b0d7-4f670d98f38a service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:57:50.613638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 771/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:57:54.600403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aada20-ef85-4cd7-8cc4-811a553ea339 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:54.601176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aada20-ef85-4cd7-8cc4-811a553ea339 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:54.601176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aada20-ef85-4cd7-8cc4-811a553ea339 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:54.602365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:57:54.608227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dcd1e-a535-4d0e-a2c2-875f7aaf4057 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:54.608636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dcd1e-a535-4d0e-a2c2-875f7aaf4057 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:54.608764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dcd1e-a535-4d0e-a2c2-875f7aaf4057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:54.628478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-999dcd1e-a535-4d0e-a2c2-875f7aaf4057 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:57:54.629681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-999dcd1e-a535-4d0e-a2c2-875f7aaf4057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:54.637288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:57:54.927327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aada20-ef85-4cd7-8cc4-811a553ea339 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:57:54.929041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-92aada20-ef85-4cd7-8cc4-811a553ea339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:54.955573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:57:55.006400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aada20-ef85-4cd7-8cc4-811a553ea339 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:57:55.010590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9a7d9-75ff-4523-9281-05da79029ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:57:55.011194 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a7d9-75ff-4523-9281-05da79029ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:55.011476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a7d9-75ff-4523-9281-05da79029ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:55.011750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9a7d9-75ff-4523-9281-05da79029ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:55.020688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9a7d9-75ff-4523-9281-05da79029ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:57:55.022169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9a7d9-75ff-4523-9281-05da79029ed8 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:57:55.032232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 758/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:57:57.129365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f7e6-2f94-4a54-9b5f-d4a2ed4558d7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:57.129895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f7e6-2f94-4a54-9b5f-d4a2ed4558d7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:57.129895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427f7e6-2f94-4a54-9b5f-d4a2ed4558d7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:57.131199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:57:57.136419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61521c39-3cf5-44ed-9562-e8f3fb1ce8ed None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:57.136821 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61521c39-3cf5-44ed-9562-e8f3fb1ce8ed None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:57.137039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61521c39-3cf5-44ed-9562-e8f3fb1ce8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:57.156203 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-61521c39-3cf5-44ed-9562-e8f3fb1ce8ed None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:57:57.157439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61521c39-3cf5-44ed-9562-e8f3fb1ce8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:57:57.165977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:57:57.450155 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427f7e6-2f94-4a54-9b5f-d4a2ed4558d7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:57:57.460685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427f7e6-2f94-4a54-9b5f-d4a2ed4558d7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:57:57.464669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1459-eb0c-48ae-8a71-b43f954d1392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:57:57.465302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1459-eb0c-48ae-8a71-b43f954d1392 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:57:57.465576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1459-eb0c-48ae-8a71-b43f954d1392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:57:57.465847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1459-eb0c-48ae-8a71-b43f954d1392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:57:57.474452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1459-eb0c-48ae-8a71-b43f954d1392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:57:57.475871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1459-eb0c-48ae-8a71-b43f954d1392 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:57:57.485726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 774/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:58:01.265805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2bb25-da92-49f5-bce1-10807cfefab4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:58:01.266325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2bb25-da92-49f5-bce1-10807cfefab4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:58:01.266325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2bb25-da92-49f5-bce1-10807cfefab4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:58:01.267674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:58:01.272944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62acc-d8dd-4b94-8285-53d2770681f8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:58:01.273390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62acc-d8dd-4b94-8285-53d2770681f8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:58:01.273533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62acc-d8dd-4b94-8285-53d2770681f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:58:01.293930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-faf62acc-d8dd-4b94-8285-53d2770681f8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:58:01.295131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-faf62acc-d8dd-4b94-8285-53d2770681f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:58:01.302776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:58:01.604644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2bb25-da92-49f5-bce1-10807cfefab4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:58:01.606492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e7f2bb25-da92-49f5-bce1-10807cfefab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:58:01.684090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2bb25-da92-49f5-bce1-10807cfefab4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:58:01.687720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f2173-862c-4247-91cf-b5222b66707f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:58:01.688319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f2173-862c-4247-91cf-b5222b66707f service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:58:01.688598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f2173-862c-4247-91cf-b5222b66707f service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:58:01.688874 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f2173-862c-4247-91cf-b5222b66707f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:58:01.697586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f2173-862c-4247-91cf-b5222b66707f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:58:01.699514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f2173-862c-4247-91cf-b5222b66707f service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:58:01.708769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 761/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:58:03.830424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db6a7c-8ffb-44be-9f31-e10cf15ac3f7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:58:03.830863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db6a7c-8ffb-44be-9f31-e10cf15ac3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:58:03.830964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db6a7c-8ffb-44be-9f31-e10cf15ac3f7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:58:03.832288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 10 11:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:58:03.837466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856ebc-5c3a-4a3e-a3c0-667ffb124d2e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:58:03.837904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856ebc-5c3a-4a3e-a3c0-667ffb124d2e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:58:03.838051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856ebc-5c3a-4a3e-a3c0-667ffb124d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:58:03.858597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-29856ebc-5c3a-4a3e-a3c0-667ffb124d2e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:58:03.859769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-29856ebc-5c3a-4a3e-a3c0-667ffb124d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:58:03.867461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 10 11:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:58:04.172392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db6a7c-8ffb-44be-9f31-e10cf15ac3f7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:58:04.174115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-68db6a7c-8ffb-44be-9f31-e10cf15ac3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:58:04.187320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db6a7c-8ffb-44be-9f31-e10cf15ac3f7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:58:04.190802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3d188-9edf-4ddb-a881-dd2ae1295598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:58:04.191392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d188-9edf-4ddb-a881-dd2ae1295598 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:58:04.191669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d188-9edf-4ddb-a881-dd2ae1295598 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:58:04.191938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d188-9edf-4ddb-a881-dd2ae1295598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:58:04.201245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3d188-9edf-4ddb-a881-dd2ae1295598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:58:04.202658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3d188-9edf-4ddb-a881-dd2ae1295598 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:58:04.212168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 777/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:58:13.853809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=66 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:58:14.207961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=34 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:29.462604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1c6be-7fce-44fb-bd70-d0a184b5ecba None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.463282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1c6be-7fce-44fb-bd70-d0a184b5ecba None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.463282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1c6be-7fce-44fb-bd70-d0a184b5ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.490654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-97d1c6be-7fce-44fb-bd70-d0a184b5ecba None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:29.491855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-97d1c6be-7fce-44fb-bd70-d0a184b5ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:29.502688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 763/1540] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:29.511698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f3c9a-c07c-49a6-9a41-20867073673c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.512228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f3c9a-c07c-49a6-9a41-20867073673c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.512344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f3c9a-c07c-49a6-9a41-20867073673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.539623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-403f3c9a-c07c-49a6-9a41-20867073673c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:29.540878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-403f3c9a-c07c-49a6-9a41-20867073673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:29.554193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 778/1541] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:29.558876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1c6be-7fce-44fb-bd70-d0a184b5ecba None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:29.574162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1c6be-7fce-44fb-bd70-d0a184b5ecba None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:29.582022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:29.582629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.582909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.583170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.583811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:29.584121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:29.585727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:29.599555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 764/1542] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:29.607646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f3c9a-c07c-49a6-9a41-20867073673c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:29.622625 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f3c9a-c07c-49a6-9a41-20867073673c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:29.634170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2efc9c-a919-4157-a0f2-e5d4364842b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:29.634804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efc9c-a919-4157-a0f2-e5d4364842b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.635085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efc9c-a919-4157-a0f2-e5d4364842b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.635360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2efc9c-a919-4157-a0f2-e5d4364842b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.636015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2efc9c-a919-4157-a0f2-e5d4364842b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:29.638043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2efc9c-a919-4157-a0f2-e5d4364842b6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:29.700175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 779/1543] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:29 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:29.704536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:29.719128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b249-3637-431c-8c2c-f2ccfc42205b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:29.786711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da8fd3-7833-4d8d-b8c3-c31bf1e8484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:29.787336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da8fd3-7833-4d8d-b8c3-c31bf1e8484d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.787612 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da8fd3-7833-4d8d-b8c3-c31bf1e8484d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.787882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da8fd3-7833-4d8d-b8c3-c31bf1e8484d admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.788513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da8fd3-7833-4d8d-b8c3-c31bf1e8484d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:29.790496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da8fd3-7833-4d8d-b8c3-c31bf1e8484d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:29.836075 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 765/1544] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:29 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:29.840098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2efc9c-a919-4157-a0f2-e5d4364842b6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:29.853142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2efc9c-a919-4157-a0f2-e5d4364842b6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:29.860875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4e26-4b9d-42c8-a162-a3afad87b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:29.861853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4e26-4b9d-42c8-a162-a3afad87b8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.862300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4e26-4b9d-42c8-a162-a3afad87b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.862770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b4e26-4b9d-42c8-a162-a3afad87b8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.863602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4e26-4b9d-42c8-a162-a3afad87b8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:29.865599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b4e26-4b9d-42c8-a162-a3afad87b8f8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:29.882047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 780/1545] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:29.886469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da8fd3-7833-4d8d-b8c3-c31bf1e8484d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:29.899329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da8fd3-7833-4d8d-b8c3-c31bf1e8484d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:29.909343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686204d-f592-4fcc-8ccf-cbd494d1aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:29.909969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686204d-f592-4fcc-8ccf-cbd494d1aa1e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.910297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686204d-f592-4fcc-8ccf-cbd494d1aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.910571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686204d-f592-4fcc-8ccf-cbd494d1aa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.911218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686204d-f592-4fcc-8ccf-cbd494d1aa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:29.912882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686204d-f592-4fcc-8ccf-cbd494d1aa1e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:29.927490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 766/1546] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:29.932228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4e26-4b9d-42c8-a162-a3afad87b8f8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:29.947030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b4e26-4b9d-42c8-a162-a3afad87b8f8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:29.954032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f534ad1-4f2f-4d4c-bf89-5cff7167ddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:29.955097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534ad1-4f2f-4d4c-bf89-5cff7167ddb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.955668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534ad1-4f2f-4d4c-bf89-5cff7167ddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.956182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f534ad1-4f2f-4d4c-bf89-5cff7167ddb6 admin admin] PATH_INFO: `/v3/projects/d65be4969def472dba8adae669b7e2a7/users/b733f45e1da042b092beb8d7fb417680/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.978409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f534ad1-4f2f-4d4c-bf89-5cff7167ddb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65be4969def472dba8adae669b7e2a7, user_id=b733f45e1da042b092beb8d7fb417680, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:29.980933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18454d9-86d1-41df-896c-d55e7a706111 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:29.981303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18454d9-86d1-41df-896c-d55e7a706111 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:29.981573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18454d9-86d1-41df-896c-d55e7a706111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:29.982548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f534ad1-4f2f-4d4c-bf89-5cff7167ddb6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.013029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 781/1547] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:29 2022] PUT /identity/v3/projects/d65be4969def472dba8adae669b7e2a7/users/b733f45e1da042b092beb8d7fb417680/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:30.013469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e18454d9-86d1-41df-896c-d55e7a706111 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.014800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e18454d9-86d1-41df-896c-d55e7a706111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.057401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db745d-e8a7-4624-b007-c253348f54a8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.058057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db745d-e8a7-4624-b007-c253348f54a8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.058552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db745d-e8a7-4624-b007-c253348f54a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.110997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e4db745d-e8a7-4624-b007-c253348f54a8 None None] MFA Rules not processed for user `b733f45e1da042b092beb8d7fb417680`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.113258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e4db745d-e8a7-4624-b007-c253348f54a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.117539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 767/1548] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.131907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb81a-bda1-407e-8040-19e92956cb5e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.132415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb81a-bda1-407e-8040-19e92956cb5e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.132543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb81a-bda1-407e-8040-19e92956cb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.167004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-742fb81a-bda1-407e-8040-19e92956cb5e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.168592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-742fb81a-bda1-407e-8040-19e92956cb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.189910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 768/1549] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.191863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf7316-82ab-406c-8b29-71e07edfb37d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.192171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf7316-82ab-406c-8b29-71e07edfb37d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.192443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf7316-82ab-406c-8b29-71e07edfb37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.225882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-48bf7316-82ab-406c-8b29-71e07edfb37d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.227140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-48bf7316-82ab-406c-8b29-71e07edfb37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.242559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 769/1550] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.243510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf7316-82ab-406c-8b29-71e07edfb37d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.244367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 782/1551] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:30.252944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23dd9a-4ae0-46ee-943e-ae1d2d081abc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.253741 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23dd9a-4ae0-46ee-943e-ae1d2d081abc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.254224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23dd9a-4ae0-46ee-943e-ae1d2d081abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.265028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf7316-82ab-406c-8b29-71e07edfb37d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.267825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efdb4c-7b8f-4496-80fd-53b39ed26e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.268448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdb4c-7b8f-4496-80fd-53b39ed26e04 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.268726 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdb4c-7b8f-4496-80fd-53b39ed26e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.269024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efdb4c-7b8f-4496-80fd-53b39ed26e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.269680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efdb4c-7b8f-4496-80fd-53b39ed26e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:30.269980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efdb4c-7b8f-4496-80fd-53b39ed26e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.271566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efdb4c-7b8f-4496-80fd-53b39ed26e04 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.301499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 770/1552] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:30.302834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067399-fc07-494a-a291-5a2297ce8d12 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.303119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067399-fc07-494a-a291-5a2297ce8d12 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.303392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6067399-fc07-494a-a291-5a2297ce8d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.305181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7b23dd9a-4ae0-46ee-943e-ae1d2d081abc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.306678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7b23dd9a-4ae0-46ee-943e-ae1d2d081abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.324849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 783/1553] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.326532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b699baf-7f26-4709-b9e4-08e5bd1abf57 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.326532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b699baf-7f26-4709-b9e4-08e5bd1abf57 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.326781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b699baf-7f26-4709-b9e4-08e5bd1abf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.351205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f6067399-fc07-494a-a291-5a2297ce8d12 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.354573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f6067399-fc07-494a-a291-5a2297ce8d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.371041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2b699baf-7f26-4709-b9e4-08e5bd1abf57 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.373751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2b699baf-7f26-4709-b9e4-08e5bd1abf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.375197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 771/1554] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.377885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7570-2757-455a-bbcf-243eea447763 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.378169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7570-2757-455a-bbcf-243eea447763 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.378442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e7570-2757-455a-bbcf-243eea447763 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.382341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 772/1555] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 10 11:59:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:30.383748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e7570-2757-455a-bbcf-243eea447763 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.397443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 784/1556] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.397443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b699baf-7f26-4709-b9e4-08e5bd1abf57 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.411179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e7570-2757-455a-bbcf-243eea447763 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.413902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b699baf-7f26-4709-b9e4-08e5bd1abf57 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.421460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2308704-8f5f-4119-891e-0b8d7e36aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.422174 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2308704-8f5f-4119-891e-0b8d7e36aae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.422553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2308704-8f5f-4119-891e-0b8d7e36aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.422829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2308704-8f5f-4119-891e-0b8d7e36aae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.423614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2308704-8f5f-4119-891e-0b8d7e36aae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.424352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcb621-cdbc-420d-9a71-d3aaa6e893c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.425121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcb621-cdbc-420d-9a71-d3aaa6e893c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.425233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-c2308704-8f5f-4119-891e-0b8d7e36aae9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:59:30.425233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Oct 10 11:59:30.425233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: Oct 10 11:59:30.425558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcb621-cdbc-420d-9a71-d3aaa6e893c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.425810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcb621-cdbc-420d-9a71-d3aaa6e893c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.426540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcb621-cdbc-420d-9a71-d3aaa6e893c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:30.426659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2308704-8f5f-4119-891e-0b8d7e36aae9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.426925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcb621-cdbc-420d-9a71-d3aaa6e893c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.428008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-a2fcb621-cdbc-420d-9a71-d3aaa6e893c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:59:30.428008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Oct 10 11:59:30.428008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: Oct 10 11:59:30.428994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcb621-cdbc-420d-9a71-d3aaa6e893c3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.447081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 785/1557] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:30.449219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01f513-ae2b-4224-95ba-e744c0ce97d2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.449624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01f513-ae2b-4224-95ba-e744c0ce97d2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.449956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01f513-ae2b-4224-95ba-e744c0ce97d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.466745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 773/1558] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:30.468282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ab6be-9316-47a5-b782-4d911b92914e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.468570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ab6be-9316-47a5-b782-4d911b92914e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.468839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ab6be-9316-47a5-b782-4d911b92914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.478358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:30.481627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ae01f513-ae2b-4224-95ba-e744c0ce97d2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.482899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ae01f513-ae2b-4224-95ba-e744c0ce97d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.515701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f13ab6be-9316-47a5-b782-4d911b92914e None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.517030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f13ab6be-9316-47a5-b782-4d911b92914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.527795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:30.544065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 786/1559] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.545404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0415f-1251-4789-a551-03112ecb9aa7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.545682 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0415f-1251-4789-a551-03112ecb9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.545949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0415f-1251-4789-a551-03112ecb9aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.565576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-47f0415f-1251-4789-a551-03112ecb9aa7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.566762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-47f0415f-1251-4789-a551-03112ecb9aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.574602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 787/1560] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.578328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded06032-c1f0-4c98-b7fa-ee511dbfb921 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.578328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded06032-c1f0-4c98-b7fa-ee511dbfb921 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.578328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded06032-c1f0-4c98-b7fa-ee511dbfb921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.589993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 774/1561] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.591239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87ddb4-5bab-4197-b70f-009e3618f8e4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.596582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ded06032-c1f0-4c98-b7fa-ee511dbfb921 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.596716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87ddb4-5bab-4197-b70f-009e3618f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.596956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87ddb4-5bab-4197-b70f-009e3618f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.597836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ded06032-c1f0-4c98-b7fa-ee511dbfb921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.606032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 788/1562] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.606810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded06032-c1f0-4c98-b7fa-ee511dbfb921 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.617842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded06032-c1f0-4c98-b7fa-ee511dbfb921 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.618045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-df87ddb4-5bab-4197-b70f-009e3618f8e4 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.619156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-df87ddb4-5bab-4197-b70f-009e3618f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.622687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d22f-c5b5-42dd-9b18-15a589316750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.623287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d22f-c5b5-42dd-9b18-15a589316750 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.623565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d22f-c5b5-42dd-9b18-15a589316750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.623835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d22f-c5b5-42dd-9b18-15a589316750 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.624488 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d22f-c5b5-42dd-9b18-15a589316750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.626407 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d22f-c5b5-42dd-9b18-15a589316750 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.627693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 775/1563] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.628434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87ddb4-5bab-4197-b70f-009e3618f8e4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.638132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87ddb4-5bab-4197-b70f-009e3618f8e4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.643330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ba559-657e-4b30-9657-9d1b87db1027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.643918 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba559-657e-4b30-9657-9d1b87db1027 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.644199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba559-657e-4b30-9657-9d1b87db1027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.644462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba559-657e-4b30-9657-9d1b87db1027 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.645238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ba559-657e-4b30-9657-9d1b87db1027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.647378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ba559-657e-4b30-9657-9d1b87db1027 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.655210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 789/1564] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:30.657118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c6cf5-2c33-4e41-b89d-8c547c586168 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.657384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c6cf5-2c33-4e41-b89d-8c547c586168 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.657654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c6cf5-2c33-4e41-b89d-8c547c586168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.673924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 776/1565] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:30.674780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ba559-657e-4b30-9657-9d1b87db1027 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.679296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-594c6cf5-2c33-4e41-b89d-8c547c586168 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.680496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-594c6cf5-2c33-4e41-b89d-8c547c586168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.686066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ba559-657e-4b30-9657-9d1b87db1027 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.739587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 790/1566] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.740560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c6cf5-2c33-4e41-b89d-8c547c586168 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.743927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.744545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.744823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.745124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.745766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:30.746064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.747822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.750823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c6cf5-2c33-4e41-b89d-8c547c586168 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.755376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9779e4-e98b-44f0-9d23-3a3e77561504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.755970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9779e4-e98b-44f0-9d23-3a3e77561504 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.756245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9779e4-e98b-44f0-9d23-3a3e77561504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.756517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9779e4-e98b-44f0-9d23-3a3e77561504 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.757190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9779e4-e98b-44f0-9d23-3a3e77561504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:30.757491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9779e4-e98b-44f0-9d23-3a3e77561504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.759071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9779e4-e98b-44f0-9d23-3a3e77561504 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.759734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 777/1567] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:30.761874 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.771306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 791/1568] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:30.772537 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968dd92-1fbc-48d2-aadd-86a6aecca7c7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.772820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968dd92-1fbc-48d2-aadd-86a6aecca7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.773148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968dd92-1fbc-48d2-aadd-86a6aecca7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.792436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5968dd92-1fbc-48d2-aadd-86a6aecca7c7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.793651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5968dd92-1fbc-48d2-aadd-86a6aecca7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.801481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 792/1569] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.802647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a1de1-7788-45de-8cf1-258f8d97d7cb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.802946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a1de1-7788-45de-8cf1-258f8d97d7cb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.803196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a1de1-7788-45de-8cf1-258f8d97d7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.823224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-983a1de1-7788-45de-8cf1-258f8d97d7cb None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.824407 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-983a1de1-7788-45de-8cf1-258f8d97d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.825955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:30.833529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 793/1570] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.834359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a1de1-7788-45de-8cf1-258f8d97d7cb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.843663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a1de1-7788-45de-8cf1-258f8d97d7cb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.847574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b657-5d44-4c40-99f7-19c7899ddfbf admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.848719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.849326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.849605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.849875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.850486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.851490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:59:30.851490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Oct 10 11:59:30.851490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: Oct 10 11:59:30.852666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.853406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85c807-2ca0-42b3-aa30-06d25b92ee9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.854016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c807-2ca0-42b3-aa30-06d25b92ee9c service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.854297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c807-2ca0-42b3-aa30-06d25b92ee9c service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.854569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85c807-2ca0-42b3-aa30-06d25b92ee9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.873902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 794/1571] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:30.874546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.883891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00bd64-d0c7-40f0-bebd-e2c5dc1ac45a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.888567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a429f8-8ed0-4fb3-b20b-be60f8342af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.889209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a429f8-8ed0-4fb3-b20b-be60f8342af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.889498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a429f8-8ed0-4fb3-b20b-be60f8342af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.889748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a429f8-8ed0-4fb3-b20b-be60f8342af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.890367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a429f8-8ed0-4fb3-b20b-be60f8342af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.891943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a429f8-8ed0-4fb3-b20b-be60f8342af0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.902586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 795/1572] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:30.903815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6cd0-3031-4d0d-9262-f3d4ddd02114 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.904218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6cd0-3031-4d0d-9262-f3d4ddd02114 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.904492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf6cd0-3031-4d0d-9262-f3d4ddd02114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.916542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85c807-2ca0-42b3-aa30-06d25b92ee9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.918596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85c807-2ca0-42b3-aa30-06d25b92ee9c service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.923347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-13cf6cd0-3031-4d0d-9262-f3d4ddd02114 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:30.925380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-13cf6cd0-3031-4d0d-9262-f3d4ddd02114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:30.928289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 778/1573] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:30.929132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85c807-2ca0-42b3-aa30-06d25b92ee9c service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.933517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 796/1574] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:30.934140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf6cd0-3031-4d0d-9262-f3d4ddd02114 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.943559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85c807-2ca0-42b3-aa30-06d25b92ee9c service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.943835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf6cd0-3031-4d0d-9262-f3d4ddd02114 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:30.948079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f71ce-2ff8-4716-b1a0-79a2e8bc962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.948282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2285d-885e-414d-a495-68232e48e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:30.948680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f71ce-2ff8-4716-b1a0-79a2e8bc962e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.948813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2285d-885e-414d-a495-68232e48e5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:30.949039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f71ce-2ff8-4716-b1a0-79a2e8bc962e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.949155 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2285d-885e-414d-a495-68232e48e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:30.949242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f71ce-2ff8-4716-b1a0-79a2e8bc962e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.949416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2285d-885e-414d-a495-68232e48e5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:30.949869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f71ce-2ff8-4716-b1a0-79a2e8bc962e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.949978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2285d-885e-414d-a495-68232e48e5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:30.951771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f71ce-2ff8-4716-b1a0-79a2e8bc962e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.951875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2285d-885e-414d-a495-68232e48e5b4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:30.982335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 779/1575] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:30.982335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f71ce-2ff8-4716-b1a0-79a2e8bc962e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:30.988049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 797/1576] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:30.988049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2285d-885e-414d-a495-68232e48e5b4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.025738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:31.054245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f71ce-2ff8-4716-b1a0-79a2e8bc962e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.057747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2285d-885e-414d-a495-68232e48e5b4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.059288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.059891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.060200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.060467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.061139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:31.061441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.062937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.063061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.063619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.063970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.064446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.065162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:31.065467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.067065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.076298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 780/1577] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:31.078001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.078861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 798/1578] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:31.079659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.093009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870fb87-fb46-4916-a1ab-282b3c395f96 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.093940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cee5c-ced4-4f94-9680-7e04ecfe21c9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.098998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f471d3-7af2-4cb2-bd04-6596143cdf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.099132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec95ad-a283-4fef-a79f-e1e1ee3ae8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.099627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f471d3-7af2-4cb2-bd04-6596143cdf48 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.099747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec95ad-a283-4fef-a79f-e1e1ee3ae8ee admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.099912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f471d3-7af2-4cb2-bd04-6596143cdf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.100131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec95ad-a283-4fef-a79f-e1e1ee3ae8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.100246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f471d3-7af2-4cb2-bd04-6596143cdf48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.100464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec95ad-a283-4fef-a79f-e1e1ee3ae8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.100815 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f471d3-7af2-4cb2-bd04-6596143cdf48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.101250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec95ad-a283-4fef-a79f-e1e1ee3ae8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.102441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f471d3-7af2-4cb2-bd04-6596143cdf48 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.102950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec95ad-a283-4fef-a79f-e1e1ee3ae8ee admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.113246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 781/1579] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.114419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 799/1580] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.116826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f471d3-7af2-4cb2-bd04-6596143cdf48 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.118072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec95ad-a283-4fef-a79f-e1e1ee3ae8ee admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.127413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f471d3-7af2-4cb2-bd04-6596143cdf48 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.127797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec95ad-a283-4fef-a79f-e1e1ee3ae8ee admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.132172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.132344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66552826-e14e-436b-a835-da9d61aa4743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.132758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.132882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552826-e14e-436b-a835-da9d61aa4743 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.133180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552826-e14e-436b-a835-da9d61aa4743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.133298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.133471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552826-e14e-436b-a835-da9d61aa4743 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.133583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.134067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552826-e14e-436b-a835-da9d61aa4743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.134172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:31.134376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.135938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.136047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552826-e14e-436b-a835-da9d61aa4743 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.150756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 782/1581] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:31.159142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.164137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 800/1582] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/users => generated 278 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.164137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66552826-e14e-436b-a835-da9d61aa4743 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.170384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c622311-1ed9-4eda-b199-2816689a0614 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.175393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66552826-e14e-436b-a835-da9d61aa4743 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.175916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c3b7-4a23-4746-b8ca-5ebc3a50cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.176523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c3b7-4a23-4746-b8ca-5ebc3a50cee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.176799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c3b7-4a23-4746-b8ca-5ebc3a50cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.177125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c3b7-4a23-4746-b8ca-5ebc3a50cee1 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.177755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c3b7-4a23-4746-b8ca-5ebc3a50cee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.179716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c3b7-4a23-4746-b8ca-5ebc3a50cee1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.180003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b909a-c319-46f7-9ebd-76ab64e60da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.180595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b909a-c319-46f7-9ebd-76ab64e60da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.180868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b909a-c319-46f7-9ebd-76ab64e60da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.181179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b909a-c319-46f7-9ebd-76ab64e60da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.181796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b909a-c319-46f7-9ebd-76ab64e60da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.183665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b909a-c319-46f7-9ebd-76ab64e60da4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.204061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 783/1583] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.204061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c3b7-4a23-4746-b8ca-5ebc3a50cee1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.214598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 801/1584] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.214787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c3b7-4a23-4746-b8ca-5ebc3a50cee1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.214905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b909a-c319-46f7-9ebd-76ab64e60da4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.231516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:31.274010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b909a-c319-46f7-9ebd-76ab64e60da4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.274641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591855f-8d4b-4d67-b220-6739212ffbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.275251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591855f-8d4b-4d67-b220-6739212ffbfb admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.275529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591855f-8d4b-4d67-b220-6739212ffbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.275851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591855f-8d4b-4d67-b220-6739212ffbfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.276420 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591855f-8d4b-4d67-b220-6739212ffbfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.278341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591855f-8d4b-4d67-b220-6739212ffbfb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.278635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2286c-bdf8-45c3-8f26-d86d3d07ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.279237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2286c-bdf8-45c3-8f26-d86d3d07ec32 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.279511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2286c-bdf8-45c3-8f26-d86d3d07ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.279796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2286c-bdf8-45c3-8f26-d86d3d07ec32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.280429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2286c-bdf8-45c3-8f26-d86d3d07ec32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.282101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2286c-bdf8-45c3-8f26-d86d3d07ec32 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.292686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 802/1585] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.294027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2286c-bdf8-45c3-8f26-d86d3d07ec32 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.304218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2286c-bdf8-45c3-8f26-d86d3d07ec32 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.307042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 784/1586] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.308078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591855f-8d4b-4d67-b220-6739212ffbfb admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.309266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17ecf-5429-4ffc-a970-097629b28f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.309958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17ecf-5429-4ffc-a970-097629b28f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.310247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17ecf-5429-4ffc-a970-097629b28f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.310533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17ecf-5429-4ffc-a970-097629b28f89 admin admin] PATH_INFO: `/v3/projects/22c95afaefe14fff9b0d98f2a507e67f/users/ab4f6814b4e748a0aeb21bf1e5ca669a/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.325001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17ecf-5429-4ffc-a970-097629b28f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c95afaefe14fff9b0d98f2a507e67f, user_id=ab4f6814b4e748a0aeb21bf1e5ca669a, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.327632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17ecf-5429-4ffc-a970-097629b28f89 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.340409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 803/1587] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:31 2022] PUT /identity/v3/projects/22c95afaefe14fff9b0d98f2a507e67f/users/ab4f6814b4e748a0aeb21bf1e5ca669a/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:31.341234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17ecf-5429-4ffc-a970-097629b28f89 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.380460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591855f-8d4b-4d67-b220-6739212ffbfb admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.389679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:31.405797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17ecf-5429-4ffc-a970-097629b28f89 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.411800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e47c5f-7667-4c04-b8ba-ba0b788ac174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.412619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e47c5f-7667-4c04-b8ba-ba0b788ac174 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.412897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e47c5f-7667-4c04-b8ba-ba0b788ac174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.413200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e47c5f-7667-4c04-b8ba-ba0b788ac174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.413863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e47c5f-7667-4c04-b8ba-ba0b788ac174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.415751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e47c5f-7667-4c04-b8ba-ba0b788ac174 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.425838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 804/1588] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.427301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53c35-71b2-419a-9551-2fe05023f396 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.427587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53c35-71b2-419a-9551-2fe05023f396 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.427858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f53c35-71b2-419a-9551-2fe05023f396 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.429417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 805/1589] 10.222.0.45 () {54 vars in 912 bytes} [Mon Oct 10 11:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:31.440069 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f53c35-71b2-419a-9551-2fe05023f396 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.442342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25963682-932c-45f9-8952-9b784f100564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.443224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963682-932c-45f9-8952-9b784f100564 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.443680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963682-932c-45f9-8952-9b784f100564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.444099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963682-932c-45f9-8952-9b784f100564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.444877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25963682-932c-45f9-8952-9b784f100564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.447024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25963682-932c-45f9-8952-9b784f100564 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.453047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f53c35-71b2-419a-9551-2fe05023f396 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.458148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271d8f5-b47e-4e91-a537-37980f05a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.458496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d8f5-b47e-4e91-a537-37980f05a401 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.458769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d8f5-b47e-4e91-a537-37980f05a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.459035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d8f5-b47e-4e91-a537-37980f05a401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.459818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271d8f5-b47e-4e91-a537-37980f05a401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.461401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271d8f5-b47e-4e91-a537-37980f05a401 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.475874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 806/1590] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.475874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271d8f5-b47e-4e91-a537-37980f05a401 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.481520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 785/1591] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.482352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25963682-932c-45f9-8952-9b784f100564 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.487100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271d8f5-b47e-4e91-a537-37980f05a401 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.536335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:31.553583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5ae5b-1b51-4d13-afdf-6e3f56abe4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.554219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5ae5b-1b51-4d13-afdf-6e3f56abe4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.554723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5ae5b-1b51-4d13-afdf-6e3f56abe4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.555059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5ae5b-1b51-4d13-afdf-6e3f56abe4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.555825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5ae5b-1b51-4d13-afdf-6e3f56abe4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.558097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5ae5b-1b51-4d13-afdf-6e3f56abe4a0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.559729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25963682-932c-45f9-8952-9b784f100564 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.565763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcc964-40da-4f51-bd5a-6a473ae26bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.566431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc964-40da-4f51-bd5a-6a473ae26bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.566717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc964-40da-4f51-bd5a-6a473ae26bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.566989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcc964-40da-4f51-bd5a-6a473ae26bd0 admin admin] PATH_INFO: `/v3/projects/fac6423f314145cb931be79b845b12e1/users/8fdf7fcf986c43b895e4c76c4dd2adff/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.580693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 807/1592] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.583967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5ae5b-1b51-4d13-afdf-6e3f56abe4a0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.584080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc964-40da-4f51-bd5a-6a473ae26bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac6423f314145cb931be79b845b12e1, user_id=8fdf7fcf986c43b895e4c76c4dd2adff, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.584080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-5ebcc964-40da-4f51-bd5a-6a473ae26bd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:59:31.584080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Oct 10 11:59:31.584080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: Oct 10 11:59:31.585937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcc964-40da-4f51-bd5a-6a473ae26bd0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.591807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5ae5b-1b51-4d13-afdf-6e3f56abe4a0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.596882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90f36-8ca0-4118-b609-37d0e3ff4610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.597515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90f36-8ca0-4118-b609-37d0e3ff4610 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.597797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90f36-8ca0-4118-b609-37d0e3ff4610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.598072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90f36-8ca0-4118-b609-37d0e3ff4610 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.598704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a90f36-8ca0-4118-b609-37d0e3ff4610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.600692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a90f36-8ca0-4118-b609-37d0e3ff4610 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.602897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 786/1593] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:31 2022] PUT /identity/v3/projects/fac6423f314145cb931be79b845b12e1/users/8fdf7fcf986c43b895e4c76c4dd2adff/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:31.604358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572142-773e-416d-bd1c-db9bd1da6a99 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.604718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572142-773e-416d-bd1c-db9bd1da6a99 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.605068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572142-773e-416d-bd1c-db9bd1da6a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.628080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 808/1594] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.631895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90f36-8ca0-4118-b609-37d0e3ff4610 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.636454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-58572142-773e-416d-bd1c-db9bd1da6a99 None None] MFA Rules not processed for user `ab4f6814b4e748a0aeb21bf1e5ca669a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:31.637681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-58572142-773e-416d-bd1c-db9bd1da6a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:31.641572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90f36-8ca0-4118-b609-37d0e3ff4610 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.699736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bef0ea-bea7-42e8-996b-87f44d54ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.700350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef0ea-bea7-42e8-996b-87f44d54ee20 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.700627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef0ea-bea7-42e8-996b-87f44d54ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.700897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef0ea-bea7-42e8-996b-87f44d54ee20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.701572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bef0ea-bea7-42e8-996b-87f44d54ee20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.702737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 787/1595] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:31.703179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bef0ea-bea7-42e8-996b-87f44d54ee20 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.704127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252f74e-bcea-4b85-96ea-88fc8b8b26f0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.704528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252f74e-bcea-4b85-96ea-88fc8b8b26f0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.704802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252f74e-bcea-4b85-96ea-88fc8b8b26f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.718294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 809/1596] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.718294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bef0ea-bea7-42e8-996b-87f44d54ee20 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.724602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b252f74e-bcea-4b85-96ea-88fc8b8b26f0 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:31.725841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bef0ea-bea7-42e8-996b-87f44d54ee20 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.725977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b252f74e-bcea-4b85-96ea-88fc8b8b26f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:31.730546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb20f6-58e5-486a-80fa-2bb6567285d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.731652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb20f6-58e5-486a-80fa-2bb6567285d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.731930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb20f6-58e5-486a-80fa-2bb6567285d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.732199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb20f6-58e5-486a-80fa-2bb6567285d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.732998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb20f6-58e5-486a-80fa-2bb6567285d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.734797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb20f6-58e5-486a-80fa-2bb6567285d9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.746089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 810/1597] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.746089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb20f6-58e5-486a-80fa-2bb6567285d9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.757134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb20f6-58e5-486a-80fa-2bb6567285d9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.761635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ca42-52ed-45ff-8937-0de0e73b7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.762199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ca42-52ed-45ff-8937-0de0e73b7d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.762472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ca42-52ed-45ff-8937-0de0e73b7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.762737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230ca42-52ed-45ff-8937-0de0e73b7d03 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.763341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ca42-52ed-45ff-8937-0de0e73b7d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.765278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230ca42-52ed-45ff-8937-0de0e73b7d03 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.787920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 811/1598] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.788648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ca42-52ed-45ff-8937-0de0e73b7d03 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.795677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 788/1599] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:31.798304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230ca42-52ed-45ff-8937-0de0e73b7d03 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.798441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cb772-775c-463d-81e9-77d28cb83ad6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.798771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cb772-775c-463d-81e9-77d28cb83ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.799666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cb772-775c-463d-81e9-77d28cb83ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.803983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae20b7-7bc2-4ddb-9598-f3a6e0eb5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.804580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae20b7-7bc2-4ddb-9598-f3a6e0eb5af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.804861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae20b7-7bc2-4ddb-9598-f3a6e0eb5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.805166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae20b7-7bc2-4ddb-9598-f3a6e0eb5af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.805842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae20b7-7bc2-4ddb-9598-f3a6e0eb5af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.807496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae20b7-7bc2-4ddb-9598-f3a6e0eb5af6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.819034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 812/1600] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.819933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae20b7-7bc2-4ddb-9598-f3a6e0eb5af6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.824337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-987cb772-775c-463d-81e9-77d28cb83ad6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:31.824863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:31.825567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-987cb772-775c-463d-81e9-77d28cb83ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:31.829824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae20b7-7bc2-4ddb-9598-f3a6e0eb5af6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.833889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 789/1601] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:31.834712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cb772-775c-463d-81e9-77d28cb83ad6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.838757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f78e-0c46-45a3-bdf7-a3e966af1462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.839450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f78e-0c46-45a3-bdf7-a3e966af1462 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.839802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f78e-0c46-45a3-bdf7-a3e966af1462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.840147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f78e-0c46-45a3-bdf7-a3e966af1462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.840889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36f78e-0c46-45a3-bdf7-a3e966af1462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.842585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36f78e-0c46-45a3-bdf7-a3e966af1462 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.844239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cb772-775c-463d-81e9-77d28cb83ad6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.849902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e42aa-0ffe-4c68-ab83-04fcb6006f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.850527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e42aa-0ffe-4c68-ab83-04fcb6006f73 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.850802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e42aa-0ffe-4c68-ab83-04fcb6006f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.851072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e42aa-0ffe-4c68-ab83-04fcb6006f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.851716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e42aa-0ffe-4c68-ab83-04fcb6006f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.853671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e42aa-0ffe-4c68-ab83-04fcb6006f73 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.857898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 813/1602] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:31.857898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f78e-0c46-45a3-bdf7-a3e966af1462 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.867568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f78e-0c46-45a3-bdf7-a3e966af1462 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.872572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b8322-b9d9-4275-b2ab-3c551c1b007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.873160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b8322-b9d9-4275-b2ab-3c551c1b007d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.873583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b8322-b9d9-4275-b2ab-3c551c1b007d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.873962 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b8322-b9d9-4275-b2ab-3c551c1b007d admin admin] PATH_INFO: `/v3/projects/389e31c223e34b8ab3116e352408c996/users/ab07c60fcf6f42eaaadad92ebb30dffb/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.889177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 790/1603] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:31 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:31.890137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e42aa-0ffe-4c68-ab83-04fcb6006f73 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.891786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b8322-b9d9-4275-b2ab-3c551c1b007d admin admin] RBAC: Authorizing `identity:create_grant(project_id=389e31c223e34b8ab3116e352408c996, user_id=ab07c60fcf6f42eaaadad92ebb30dffb, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.894549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b8322-b9d9-4275-b2ab-3c551c1b007d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:31.906576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:31.919013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 814/1604] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:31 2022] PUT /identity/v3/projects/389e31c223e34b8ab3116e352408c996/users/ab07c60fcf6f42eaaadad92ebb30dffb/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:31.919013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b8322-b9d9-4275-b2ab-3c551c1b007d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:31.964771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e42aa-0ffe-4c68-ab83-04fcb6006f73 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.988653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b8322-b9d9-4275-b2ab-3c551c1b007d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:31.993366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111371fb-fc57-4032-92b3-32f23c392e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:31.994076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111371fb-fc57-4032-92b3-32f23c392e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:31.994250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111371fb-fc57-4032-92b3-32f23c392e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:31.994633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111371fb-fc57-4032-92b3-32f23c392e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:31.995286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111371fb-fc57-4032-92b3-32f23c392e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:31.996922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111371fb-fc57-4032-92b3-32f23c392e34 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.009732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 815/1605] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:32.009732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111371fb-fc57-4032-92b3-32f23c392e34 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.022052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee846-b586-46af-aa37-4073cbf3405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.022718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee846-b586-46af-aa37-4073cbf3405a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.023002 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee846-b586-46af-aa37-4073cbf3405a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.023279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee846-b586-46af-aa37-4073cbf3405a admin admin] PATH_INFO: `/v3/projects/0a2e1ef6e24c4c749d21433d2d4ff276/users/a5e6d1b071154274a91124f1fcadac1a/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.038302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bee846-b586-46af-aa37-4073cbf3405a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2e1ef6e24c4c749d21433d2d4ff276, user_id=a5e6d1b071154274a91124f1fcadac1a, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.040953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bee846-b586-46af-aa37-4073cbf3405a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.054998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 791/1606] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:31 2022] PUT /identity/v3/projects/0a2e1ef6e24c4c749d21433d2d4ff276/users/a5e6d1b071154274a91124f1fcadac1a/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:32.055874 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee846-b586-46af-aa37-4073cbf3405a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.074071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111371fb-fc57-4032-92b3-32f23c392e34 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.117902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee846-b586-46af-aa37-4073cbf3405a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.122584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3aa5-0e05-4423-92f0-fba8e1f13879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.123188 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3aa5-0e05-4423-92f0-fba8e1f13879 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.123472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3aa5-0e05-4423-92f0-fba8e1f13879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.123763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe3aa5-0e05-4423-92f0-fba8e1f13879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.124258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.124395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe3aa5-0e05-4423-92f0-fba8e1f13879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.124868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.125184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.125461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.126125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe3aa5-0e05-4423-92f0-fba8e1f13879 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.135680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 792/1607] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:32.136471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3aa5-0e05-4423-92f0-fba8e1f13879 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.146674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe3aa5-0e05-4423-92f0-fba8e1f13879 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.152397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a13ebc-73f9-4a5f-be24-44258193a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.153079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a13ebc-73f9-4a5f-be24-44258193a430 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.153364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a13ebc-73f9-4a5f-be24-44258193a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.153644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a13ebc-73f9-4a5f-be24-44258193a430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.154299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a13ebc-73f9-4a5f-be24-44258193a430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.155883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a13ebc-73f9-4a5f-be24-44258193a430 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.161196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:32.167442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 793/1608] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:32.169405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a13ebc-73f9-4a5f-be24-44258193a430 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.179610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a13ebc-73f9-4a5f-be24-44258193a430 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.184258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0971c9b-c477-4705-bd46-afdb2db4e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.184838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971c9b-c477-4705-bd46-afdb2db4e8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.185156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971c9b-c477-4705-bd46-afdb2db4e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.185430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0971c9b-c477-4705-bd46-afdb2db4e8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.186076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0971c9b-c477-4705-bd46-afdb2db4e8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.187965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0971c9b-c477-4705-bd46-afdb2db4e8a9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.197746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.199239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.209193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 794/1609] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:32 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:32.210458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366e6d-f26f-4d42-a702-0e109416f82e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.210890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366e6d-f26f-4d42-a702-0e109416f82e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.211010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 816/1610] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:32.211566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.213040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366e6d-f26f-4d42-a702-0e109416f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.213181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:32.236669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:32.245274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-53366e6d-f26f-4d42-a702-0e109416f82e None None] MFA Rules not processed for user `ab07c60fcf6f42eaaadad92ebb30dffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:32.246518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-53366e6d-f26f-4d42-a702-0e109416f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:32.274618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61284299-9d9f-43ed-96aa-982236a1f1ba service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.277972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5bed0-dbd5-4e70-8f07-e9e36855b5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.278582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5bed0-dbd5-4e70-8f07-e9e36855b5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.278862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5bed0-dbd5-4e70-8f07-e9e36855b5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.279130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5bed0-dbd5-4e70-8f07-e9e36855b5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.289236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5bed0-dbd5-4e70-8f07-e9e36855b5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.290594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5bed0-dbd5-4e70-8f07-e9e36855b5f8 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.302595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 817/1611] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:32.303260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5bed0-dbd5-4e70-8f07-e9e36855b5f8 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.315891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5bed0-dbd5-4e70-8f07-e9e36855b5f8 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.322653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d982b-d821-45f0-aaff-cca05c6d066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.324270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d982b-d821-45f0-aaff-cca05c6d066a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.324941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d982b-d821-45f0-aaff-cca05c6d066a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.326121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d982b-d821-45f0-aaff-cca05c6d066a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.327088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d982b-d821-45f0-aaff-cca05c6d066a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.329147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d982b-d821-45f0-aaff-cca05c6d066a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.334917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 795/1612] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:32.336391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f41f-8a58-48a1-b5c1-a91f255dd470 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.336686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f41f-8a58-48a1-b5c1-a91f255dd470 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.337177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9f41f-8a58-48a1-b5c1-a91f255dd470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.344248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 818/1613] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:32.345391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d982b-d821-45f0-aaff-cca05c6d066a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.360251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d982b-d821-45f0-aaff-cca05c6d066a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.366117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c430df-b40e-4f6d-8d74-7db3abb3050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.367071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c430df-b40e-4f6d-8d74-7db3abb3050e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.367349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c430df-b40e-4f6d-8d74-7db3abb3050e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.367771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c430df-b40e-4f6d-8d74-7db3abb3050e admin admin] PATH_INFO: `/v3/projects/1934b77d066f47288897e48dacefc20d/users/912b5f1275fb43dfb1c0a9c47ecb3fc9/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.370586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b5c9f41f-8a58-48a1-b5c1-a91f255dd470 None None] MFA Rules not processed for user `a5e6d1b071154274a91124f1fcadac1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:32.371812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b5c9f41f-8a58-48a1-b5c1-a91f255dd470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:32.388804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c430df-b40e-4f6d-8d74-7db3abb3050e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1934b77d066f47288897e48dacefc20d, user_id=912b5f1275fb43dfb1c0a9c47ecb3fc9, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.392186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c430df-b40e-4f6d-8d74-7db3abb3050e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.417082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 819/1614] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:32 2022] PUT /identity/v3/projects/1934b77d066f47288897e48dacefc20d/users/912b5f1275fb43dfb1c0a9c47ecb3fc9/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:32.418879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c430df-b40e-4f6d-8d74-7db3abb3050e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.479191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 796/1615] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:32.479191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9f41f-8a58-48a1-b5c1-a91f255dd470 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.513583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9f41f-8a58-48a1-b5c1-a91f255dd470 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.521532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c430df-b40e-4f6d-8d74-7db3abb3050e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.525794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f251f27-fb5d-4fa1-840e-a4b390f36e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.526385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f251f27-fb5d-4fa1-840e-a4b390f36e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.526668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f251f27-fb5d-4fa1-840e-a4b390f36e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.526941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f251f27-fb5d-4fa1-840e-a4b390f36e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.527595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f251f27-fb5d-4fa1-840e-a4b390f36e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.528809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfc135-9e0c-4411-8248-4c32b0f8e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.529240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f251f27-fb5d-4fa1-840e-a4b390f36e2d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.529882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc135-9e0c-4411-8248-4c32b0f8e8a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.530390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc135-9e0c-4411-8248-4c32b0f8e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.530825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc135-9e0c-4411-8248-4c32b0f8e8a1 admin admin] PATH_INFO: `/v3/projects/938258dab1fa48449a751e24b6d8384c/users/5d6271f24cdc4a5094c1bb654d524eb3/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.558143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 797/1616] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:32.559321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f251f27-fb5d-4fa1-840e-a4b390f36e2d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.570507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f251f27-fb5d-4fa1-840e-a4b390f36e2d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.573545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfc135-9e0c-4411-8248-4c32b0f8e8a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938258dab1fa48449a751e24b6d8384c, user_id=5d6271f24cdc4a5094c1bb654d524eb3, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.576349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0966d-d467-42db-bbfc-6fdbbd3c885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.577314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0966d-d467-42db-bbfc-6fdbbd3c885f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.577605 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0966d-d467-42db-bbfc-6fdbbd3c885f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.577911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0966d-d467-42db-bbfc-6fdbbd3c885f admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.578617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0966d-d467-42db-bbfc-6fdbbd3c885f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.579590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfc135-9e0c-4411-8248-4c32b0f8e8a1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.581505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0966d-d467-42db-bbfc-6fdbbd3c885f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.601588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 820/1617] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:32 2022] PUT /identity/v3/projects/938258dab1fa48449a751e24b6d8384c/users/5d6271f24cdc4a5094c1bb654d524eb3/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:32.602484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfc135-9e0c-4411-8248-4c32b0f8e8a1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.621373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 798/1618] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:32 2022] POST /identity/v3/projects => generated 357 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:32.622785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a386-f022-4b9e-93a2-fc1d9834721a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.623069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a386-f022-4b9e-93a2-fc1d9834721a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.623341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a386-f022-4b9e-93a2-fc1d9834721a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.626711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:32.661084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-17c2a386-f022-4b9e-93a2-fc1d9834721a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:32.662896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-17c2a386-f022-4b9e-93a2-fc1d9834721a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:32.693847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfc135-9e0c-4411-8248-4c32b0f8e8a1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.745632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:32.775453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 799/1619] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:32.777007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0969c-da53-4c54-8598-30b21e4af593 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.777357 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0969c-da53-4c54-8598-30b21e4af593 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.777623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0969c-da53-4c54-8598-30b21e4af593 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.780220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 800/1620] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 10 11:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:32.786099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0969c-da53-4c54-8598-30b21e4af593 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:32.788161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c43b36-e18d-442e-8e95-df5af25ee0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.789268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43b36-e18d-442e-8e95-df5af25ee0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.789825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43b36-e18d-442e-8e95-df5af25ee0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.790324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c43b36-e18d-442e-8e95-df5af25ee0ee admin admin] PATH_INFO: `/v3/projects/b9839e69dabd4284ac4204a8138dcff4/users/e943ed71010244489363229028cf6acf/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.818434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c43b36-e18d-442e-8e95-df5af25ee0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9839e69dabd4284ac4204a8138dcff4, user_id=e943ed71010244489363229028cf6acf, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.821941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c43b36-e18d-442e-8e95-df5af25ee0ee admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.825115 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0969c-da53-4c54-8598-30b21e4af593 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:32.831108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa54f2b-c082-4e8e-9f8d-381695e0755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:32.832495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54f2b-c082-4e8e-9f8d-381695e0755a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.832799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54f2b-c082-4e8e-9f8d-381695e0755a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.833093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54f2b-c082-4e8e-9f8d-381695e0755a admin admin] PATH_INFO: `/v3/projects/2340216440324735b210103d1ecf4434/users/4deeb8a13f9e4abca719f2a271a62ed5/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.843612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 821/1621] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:32 2022] PUT /identity/v3/projects/b9839e69dabd4284ac4204a8138dcff4/users/e943ed71010244489363229028cf6acf/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:32.846719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91148415-0834-46fb-84b8-e4e4c8a2e0f3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:32.846719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91148415-0834-46fb-84b8-e4e4c8a2e0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:32.846719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91148415-0834-46fb-84b8-e4e4c8a2e0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:32.866309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa54f2b-c082-4e8e-9f8d-381695e0755a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2340216440324735b210103d1ecf4434, user_id=4deeb8a13f9e4abca719f2a271a62ed5, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:32.869008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa54f2b-c082-4e8e-9f8d-381695e0755a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:32.889687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-91148415-0834-46fb-84b8-e4e4c8a2e0f3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:32.894462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-91148415-0834-46fb-84b8-e4e4c8a2e0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:32.900619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 801/1622] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:32 2022] PUT /identity/v3/projects/2340216440324735b210103d1ecf4434/users/4deeb8a13f9e4abca719f2a271a62ed5/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:32.901668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa54f2b-c082-4e8e-9f8d-381695e0755a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.002720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa54f2b-c082-4e8e-9f8d-381695e0755a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.008119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d984437-4c59-4e87-bc07-88967c895560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.008820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984437-4c59-4e87-bc07-88967c895560 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.009058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984437-4c59-4e87-bc07-88967c895560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.009339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d984437-4c59-4e87-bc07-88967c895560 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.010083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d984437-4c59-4e87-bc07-88967c895560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.014328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 822/1623] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:33.014443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d984437-4c59-4e87-bc07-88967c895560 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.014543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91148415-0834-46fb-84b8-e4e4c8a2e0f3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.046558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 802/1624] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:32 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:33.046558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c502c6-d752-4689-af9b-5037dd26c909 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.046558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c502c6-d752-4689-af9b-5037dd26c909 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.046558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c502c6-d752-4689-af9b-5037dd26c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.070988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-10c502c6-d752-4689-af9b-5037dd26c909 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:33.073603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-10c502c6-d752-4689-af9b-5037dd26c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:33.136215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:33.155048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91148415-0834-46fb-84b8-e4e4c8a2e0f3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.156732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afd98b-c48a-4aa6-8839-5c77db5d356c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.157386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd98b-c48a-4aa6-8839-5c77db5d356c service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.157663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd98b-c48a-4aa6-8839-5c77db5d356c service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.157927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afd98b-c48a-4aa6-8839-5c77db5d356c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.169421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd98b-c48a-4aa6-8839-5c77db5d356c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.171062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afd98b-c48a-4aa6-8839-5c77db5d356c service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.182965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 823/1625] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:33.184194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919ede-0a71-4c8c-838f-58dda2b5af14 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.184541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919ede-0a71-4c8c-838f-58dda2b5af14 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.184819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919ede-0a71-4c8c-838f-58dda2b5af14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.186195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 803/1626] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 10 11:59:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:33.187365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c502c6-d752-4689-af9b-5037dd26c909 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.198941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c502c6-d752-4689-af9b-5037dd26c909 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.206558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498508f3-dd89-4205-9d3c-e1840c3db3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.207260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498508f3-dd89-4205-9d3c-e1840c3db3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.207546 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498508f3-dd89-4205-9d3c-e1840c3db3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.207824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498508f3-dd89-4205-9d3c-e1840c3db3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.208571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498508f3-dd89-4205-9d3c-e1840c3db3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.210505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498508f3-dd89-4205-9d3c-e1840c3db3c7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.220578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2f919ede-0a71-4c8c-838f-58dda2b5af14 None None] MFA Rules not processed for user `e943ed71010244489363229028cf6acf`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:33.222641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2f919ede-0a71-4c8c-838f-58dda2b5af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:33.229960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 804/1627] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:33.234707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498508f3-dd89-4205-9d3c-e1840c3db3c7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.248441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498508f3-dd89-4205-9d3c-e1840c3db3c7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.254871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65934d59-a4bd-45c8-9251-097cab80f915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.256368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934d59-a4bd-45c8-9251-097cab80f915 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.256726 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934d59-a4bd-45c8-9251-097cab80f915 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.257785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934d59-a4bd-45c8-9251-097cab80f915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.276636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65934d59-a4bd-45c8-9251-097cab80f915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.278493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65934d59-a4bd-45c8-9251-097cab80f915 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.298778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 805/1628] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:33.299885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65934d59-a4bd-45c8-9251-097cab80f915 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.313291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65934d59-a4bd-45c8-9251-097cab80f915 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.326016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f867a-89d6-4b54-b306-b7d944afa5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.326548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f867a-89d6-4b54-b306-b7d944afa5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.327070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f867a-89d6-4b54-b306-b7d944afa5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.327343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f867a-89d6-4b54-b306-b7d944afa5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.329389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f867a-89d6-4b54-b306-b7d944afa5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.334207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f867a-89d6-4b54-b306-b7d944afa5fa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.367283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 806/1629] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:33.371948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 824/1630] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:33.372103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f867a-89d6-4b54-b306-b7d944afa5fa admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.372190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f919ede-0a71-4c8c-838f-58dda2b5af14 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.390535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f919ede-0a71-4c8c-838f-58dda2b5af14 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.400591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f867a-89d6-4b54-b306-b7d944afa5fa admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.404736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ea54c-3e22-4314-929c-32b28cd6c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.406586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ea54c-3e22-4314-929c-32b28cd6c85e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.407865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ea54c-3e22-4314-929c-32b28cd6c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.408987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ea54c-3e22-4314-929c-32b28cd6c85e admin admin] PATH_INFO: `/v3/projects/2340216440324735b210103d1ecf4434/users/4deeb8a13f9e4abca719f2a271a62ed5/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.415261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81e29e-0a5a-48ea-9da5-27e515827e76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.415944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81e29e-0a5a-48ea-9da5-27e515827e76 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.416278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81e29e-0a5a-48ea-9da5-27e515827e76 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.416561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81e29e-0a5a-48ea-9da5-27e515827e76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.418662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ea54c-3e22-4314-929c-32b28cd6c85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2340216440324735b210103d1ecf4434, user_id=4deeb8a13f9e4abca719f2a271a62ed5, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.425990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ea54c-3e22-4314-929c-32b28cd6c85e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.442492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:33.454286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 825/1631] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:33 2022] PUT /identity/v3/projects/2340216440324735b210103d1ecf4434/users/4deeb8a13f9e4abca719f2a271a62ed5/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:33.458353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ea54c-3e22-4314-929c-32b28cd6c85e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.491116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81e29e-0a5a-48ea-9da5-27e515827e76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.493064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81e29e-0a5a-48ea-9da5-27e515827e76 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.505184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 807/1632] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:33.506276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81e29e-0a5a-48ea-9da5-27e515827e76 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.603282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81e29e-0a5a-48ea-9da5-27e515827e76 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.649201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ea54c-3e22-4314-929c-32b28cd6c85e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.654114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036f0e3-8fd0-497f-8cbd-1d220352f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.655040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036f0e3-8fd0-497f-8cbd-1d220352f1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.655610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036f0e3-8fd0-497f-8cbd-1d220352f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.655989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036f0e3-8fd0-497f-8cbd-1d220352f1cf admin admin] PATH_INFO: `/v3/projects/3287e8a56a1d4a80b373e27247684b81/users/34386b400d1d446c99e8b11084ba4c40/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.676878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036f0e3-8fd0-497f-8cbd-1d220352f1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3287e8a56a1d4a80b373e27247684b81, user_id=34386b400d1d446c99e8b11084ba4c40, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.681453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036f0e3-8fd0-497f-8cbd-1d220352f1cf admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.714524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 826/1633] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:33 2022] PUT /identity/v3/projects/3287e8a56a1d4a80b373e27247684b81/users/34386b400d1d446c99e8b11084ba4c40/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:33.717258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0264ae-63aa-4ba1-87e3-0ec23513b7a5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.717548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0264ae-63aa-4ba1-87e3-0ec23513b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.717823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0264ae-63aa-4ba1-87e3-0ec23513b7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.726651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7968f48-a308-4421-a06b-5ffbb897f8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.727384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7968f48-a308-4421-a06b-5ffbb897f8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.727619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7968f48-a308-4421-a06b-5ffbb897f8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.729211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7968f48-a308-4421-a06b-5ffbb897f8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.780373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6c0264ae-63aa-4ba1-87e3-0ec23513b7a5 None None] MFA Rules not processed for user `4deeb8a13f9e4abca719f2a271a62ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:33.783675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6c0264ae-63aa-4ba1-87e3-0ec23513b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:33.854984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7968f48-a308-4421-a06b-5ffbb897f8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.858023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:33.858778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7968f48-a308-4421-a06b-5ffbb897f8a6 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:33.884855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 808/1634] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:33.887345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7968f48-a308-4421-a06b-5ffbb897f8a6 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.909654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7968f48-a308-4421-a06b-5ffbb897f8a6 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:33.928949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 827/1635] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:33.941924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0264ae-63aa-4ba1-87e3-0ec23513b7a5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:33.943814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:33.985042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42426df9-8f54-4381-88ae-1f67678aa79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:33.985812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426df9-8f54-4381-88ae-1f67678aa79b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:33.987314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426df9-8f54-4381-88ae-1f67678aa79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:33.987314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426df9-8f54-4381-88ae-1f67678aa79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:33.988102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426df9-8f54-4381-88ae-1f67678aa79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:33.990493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426df9-8f54-4381-88ae-1f67678aa79b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:34.013050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 809/1636] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:34.015019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42426df9-8f54-4381-88ae-1f67678aa79b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:34.032406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42426df9-8f54-4381-88ae-1f67678aa79b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:34.051343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adebe0-6a8b-4ed4-945a-7be24bac28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:34.052121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adebe0-6a8b-4ed4-945a-7be24bac28a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:34.052521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adebe0-6a8b-4ed4-945a-7be24bac28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:34.052968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adebe0-6a8b-4ed4-945a-7be24bac28a9 admin admin] PATH_INFO: `/v3/projects/3287e8a56a1d4a80b373e27247684b81/users/34386b400d1d446c99e8b11084ba4c40/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:34.055376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adebe0-6a8b-4ed4-945a-7be24bac28a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3287e8a56a1d4a80b373e27247684b81, user_id=34386b400d1d446c99e8b11084ba4c40, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:34.067792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adebe0-6a8b-4ed4-945a-7be24bac28a9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:34.089262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 810/1637] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:34 2022] PUT /identity/v3/projects/3287e8a56a1d4a80b373e27247684b81/users/34386b400d1d446c99e8b11084ba4c40/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:34.091051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872f88f-2bdc-4dd3-9f59-9eb5404e0890 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:34.091537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872f88f-2bdc-4dd3-9f59-9eb5404e0890 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:34.091899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872f88f-2bdc-4dd3-9f59-9eb5404e0890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:34.108268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0264ae-63aa-4ba1-87e3-0ec23513b7a5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:34.134299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6872f88f-2bdc-4dd3-9f59-9eb5404e0890 None None] MFA Rules not processed for user `34386b400d1d446c99e8b11084ba4c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:34.136172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6872f88f-2bdc-4dd3-9f59-9eb5404e0890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:34.270946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81731a43-4fd3-424b-ba3d-d2c19a088a88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:34.274231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81731a43-4fd3-424b-ba3d-d2c19a088a88 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:34.275039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81731a43-4fd3-424b-ba3d-d2c19a088a88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:34.275413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81731a43-4fd3-424b-ba3d-d2c19a088a88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:34.349215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 811/1638] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:34.351118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345449e-6fe6-4ef3-9bef-30a27d638f43 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:34.351519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345449e-6fe6-4ef3-9bef-30a27d638f43 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:34.351891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345449e-6fe6-4ef3-9bef-30a27d638f43 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:34.353643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 812/1639] 10.222.0.45 () {54 vars in 912 bytes} [Mon Oct 10 11:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:34.362770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd095f-d602-4815-8cd6-37dea4c12ac8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:34.363575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd095f-d602-4815-8cd6-37dea4c12ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:34.364473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd095f-d602-4815-8cd6-37dea4c12ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:34.443069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d5fd095f-d602-4815-8cd6-37dea4c12ac8 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:34.445933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d5fd095f-d602-4815-8cd6-37dea4c12ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:34.481311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81731a43-4fd3-424b-ba3d-d2c19a088a88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:34.485872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81731a43-4fd3-424b-ba3d-d2c19a088a88 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:34.521015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 828/1640] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:34.596988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 813/1641] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 11:59:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:34.753064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81731a43-4fd3-424b-ba3d-d2c19a088a88 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:34.759558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd095f-d602-4815-8cd6-37dea4c12ac8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:34.777781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81731a43-4fd3-424b-ba3d-d2c19a088a88 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:34.777970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd095f-d602-4815-8cd6-37dea4c12ac8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:34.796811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac149155-4128-48ea-a92a-da289741882a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:34.797657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac149155-4128-48ea-a92a-da289741882a service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:34.798764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444fd6c-b350-43f5-a621-2bd230531878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:34.800738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444fd6c-b350-43f5-a621-2bd230531878 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:34.802298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac149155-4128-48ea-a92a-da289741882a service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:34.802658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac149155-4128-48ea-a92a-da289741882a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:34.803024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444fd6c-b350-43f5-a621-2bd230531878 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:34.805329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444fd6c-b350-43f5-a621-2bd230531878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:34.863992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac149155-4128-48ea-a92a-da289741882a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:34.871161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac149155-4128-48ea-a92a-da289741882a service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:34.873973 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444fd6c-b350-43f5-a621-2bd230531878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:34.876084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444fd6c-b350-43f5-a621-2bd230531878 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:34.896640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 814/1642] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 11:59:34.918896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 829/1643] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:35.338542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444fd6c-b350-43f5-a621-2bd230531878 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:35.344531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac149155-4128-48ea-a92a-da289741882a service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:35.357360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac149155-4128-48ea-a92a-da289741882a service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:35.363162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154fce7-012f-472d-9bac-d0eba36e6550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:35.363862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154fce7-012f-472d-9bac-d0eba36e6550 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:35.364359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154fce7-012f-472d-9bac-d0eba36e6550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:35.364702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154fce7-012f-472d-9bac-d0eba36e6550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:35.377597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:35.408055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:35.475168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444fd6c-b350-43f5-a621-2bd230531878 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:35.489729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:35.491381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:35.493711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:35.494522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] PATH_INFO: `/v3/users/a5e6d1b071154274a91124f1fcadac1a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:35.497405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154fce7-012f-472d-9bac-d0eba36e6550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:35.498043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e6d1b071154274a91124f1fcadac1a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:35.500960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:59:35.500960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: warnings.warn(msg) Oct 10 11:59:35.500960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: Oct 10 11:59:35.502557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154fce7-012f-472d-9bac-d0eba36e6550 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:35.507021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:35.533922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 830/1644] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:35.691850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e6d1b071154274a91124f1fcadac1a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:35.746786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e6d1b071154274a91124f1fcadac1a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:35.748283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e6d1b071154274a91124f1fcadac1a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:35.770814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e6d1b071154274a91124f1fcadac1a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:35.773938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e6d1b071154274a91124f1fcadac1a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:35.829720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 815/1645] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:35 2022] DELETE /identity/v3/users/a5e6d1b071154274a91124f1fcadac1a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:35.869619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d249a8-44f2-4509-a36f-7193df6a981d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:35.869619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d249a8-44f2-4509-a36f-7193df6a981d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:35.869619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d249a8-44f2-4509-a36f-7193df6a981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:35.905830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-26d249a8-44f2-4509-a36f-7193df6a981d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:35.918660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-26d249a8-44f2-4509-a36f-7193df6a981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:36.082869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 831/1646] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:36.117037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:36.118723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:36.285151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f397fd-aa6f-4dce-a0fd-2dc60242e9e4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:36.296461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c592acc-a5c0-404a-82a4-888881acd344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:36.297141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c592acc-a5c0-404a-82a4-888881acd344 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:36.297425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c592acc-a5c0-404a-82a4-888881acd344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:36.297699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c592acc-a5c0-404a-82a4-888881acd344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:36.325782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c592acc-a5c0-404a-82a4-888881acd344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:36.334158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c592acc-a5c0-404a-82a4-888881acd344 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:36.372658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 816/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:36.785657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d249a8-44f2-4509-a36f-7193df6a981d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:36.787609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-26d249a8-44f2-4509-a36f-7193df6a981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:36.809098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d249a8-44f2-4509-a36f-7193df6a981d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:36.824363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:36.825681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:36.826160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:36.827118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] PATH_INFO: `/v3/users/ab4f6814b4e748a0aeb21bf1e5ca669a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:36.831288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4f6814b4e748a0aeb21bf1e5ca669a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:36.834647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:37.001263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4f6814b4e748a0aeb21bf1e5ca669a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.034497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4f6814b4e748a0aeb21bf1e5ca669a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.035515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4f6814b4e748a0aeb21bf1e5ca669a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.047721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4f6814b4e748a0aeb21bf1e5ca669a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.048573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4f6814b4e748a0aeb21bf1e5ca669a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.075870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 832/1648] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:36 2022] DELETE /identity/v3/users/ab4f6814b4e748a0aeb21bf1e5ca669a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:37.079581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d56e9-74b9-4b60-b559-abad3e2bdc6d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:37.080027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d56e9-74b9-4b60-b559-abad3e2bdc6d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:37.080108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d56e9-74b9-4b60-b559-abad3e2bdc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:37.135780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6c7d56e9-74b9-4b60-b559-abad3e2bdc6d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:37.141156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6c7d56e9-74b9-4b60-b559-abad3e2bdc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:37.199641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:37.252885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 817/1649] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:37.270200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:37.271769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:37.371676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:37.423156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6656cd-c767-480a-a2d5-48b56855996b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:37.436853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236871af-9381-49a6-8b61-43d085e9b82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:37.437754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236871af-9381-49a6-8b61-43d085e9b82d service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:37.438175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236871af-9381-49a6-8b61-43d085e9b82d service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:37.438660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236871af-9381-49a6-8b61-43d085e9b82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:37.463209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236871af-9381-49a6-8b61-43d085e9b82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:37.465253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236871af-9381-49a6-8b61-43d085e9b82d service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:37.488647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 833/1650] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:37.765008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d56e9-74b9-4b60-b559-abad3e2bdc6d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:37.766475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6c7d56e9-74b9-4b60-b559-abad3e2bdc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:37.788393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d56e9-74b9-4b60-b559-abad3e2bdc6d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:37.802760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:37.803421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:37.803702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:37.803975 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] PATH_INFO: `/v3/projects/0a2e1ef6e24c4c749d21433d2d4ff276` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:37.806824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2e1ef6e24c4c749d21433d2d4ff276)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:37.813137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:37.921175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2e1ef6e24c4c749d21433d2d4ff276', 'request_id': 'req-f8bba483-7321-43bb-ab8f-b6994e3944fe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.930826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2e1ef6e24c4c749d21433d2d4ff276', 'request_id': 'req-f8bba483-7321-43bb-ab8f-b6994e3944fe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.938654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2e1ef6e24c4c749d21433d2d4ff276', 'request_id': 'req-f8bba483-7321-43bb-ab8f-b6994e3944fe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.957784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] The token cache is being invalidate because project 0a2e1ef6e24c4c749d21433d2d4ff276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:37.958424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.960113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8bba483-7321-43bb-ab8f-b6994e3944fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:37.966221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 818/1651] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:37 2022] DELETE /identity/v3/projects/0a2e1ef6e24c4c749d21433d2d4ff276 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:37.967402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e481-abda-48b0-8e98-87e42a6d3d13 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:37.967692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e481-abda-48b0-8e98-87e42a6d3d13 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:37.967991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e481-abda-48b0-8e98-87e42a6d3d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.015886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1b29e481-abda-48b0-8e98-87e42a6d3d13 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:38.018557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1b29e481-abda-48b0-8e98-87e42a6d3d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:38.193627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 834/1652] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:38.201166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fd46-7a3b-49d2-8a80-ef4b87317fff None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:38.202750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fd46-7a3b-49d2-8a80-ef4b87317fff None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:38.203226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fd46-7a3b-49d2-8a80-ef4b87317fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.263443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9567fd46-7a3b-49d2-8a80-ef4b87317fff None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:38.264805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9567fd46-7a3b-49d2-8a80-ef4b87317fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:38.308213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 819/1653] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:38.312598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e481-abda-48b0-8e98-87e42a6d3d13 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:38.326411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e481-abda-48b0-8e98-87e42a6d3d13 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:38.339025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:38.339663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:38.339934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:38.340249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.341137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:38.341954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:38.343853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:38.357629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 835/1654] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:38.361934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567fd46-7a3b-49d2-8a80-ef4b87317fff None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:38.403684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567fd46-7a3b-49d2-8a80-ef4b87317fff None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:38.416558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:38.416785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:38.422083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:38.422431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.423141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:38.429637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:38.498812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 820/1655] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:38 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:38.503033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:38.519978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe712863-1e38-41f3-bd98-106322680d0a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:38.760368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df07e-cdac-4214-b002-5ca53c44faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:38.760965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df07e-cdac-4214-b002-5ca53c44faaa admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:38.761493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df07e-cdac-4214-b002-5ca53c44faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:38.761857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df07e-cdac-4214-b002-5ca53c44faaa admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.762776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df07e-cdac-4214-b002-5ca53c44faaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:38.764589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df07e-cdac-4214-b002-5ca53c44faaa admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:38.806999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:38.809734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:38.856013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16f82b-47eb-498d-8972-eaa16ccfc17c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:38.872517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:38.875482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:38.879750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:38.885505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 836/1656] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:38 2022] POST /identity/v3/users => generated 291 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:38.885758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] PATH_INFO: `/v3/projects/22c95afaefe14fff9b0d98f2a507e67f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.888102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c95afaefe14fff9b0d98f2a507e67f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:38.894926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:38.895062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df07e-cdac-4214-b002-5ca53c44faaa admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:38.910964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df07e-cdac-4214-b002-5ca53c44faaa admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:38.918553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471d66e-7e97-400f-b9b8-aab87f6aa732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:38.919641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471d66e-7e97-400f-b9b8-aab87f6aa732 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:38.919933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471d66e-7e97-400f-b9b8-aab87f6aa732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:38.920263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471d66e-7e97-400f-b9b8-aab87f6aa732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:38.921450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471d66e-7e97-400f-b9b8-aab87f6aa732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:38.948167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471d66e-7e97-400f-b9b8-aab87f6aa732 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:39.043607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 837/1657] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:39.046564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471d66e-7e97-400f-b9b8-aab87f6aa732 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:39.063556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c95afaefe14fff9b0d98f2a507e67f', 'request_id': 'req-2571481f-81a8-40b6-a426-a4a08054f308'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.081210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c95afaefe14fff9b0d98f2a507e67f', 'request_id': 'req-2571481f-81a8-40b6-a426-a4a08054f308'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.104059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471d66e-7e97-400f-b9b8-aab87f6aa732 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:39.104871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c95afaefe14fff9b0d98f2a507e67f', 'request_id': 'req-2571481f-81a8-40b6-a426-a4a08054f308'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.139603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] The token cache is being invalidate because project 22c95afaefe14fff9b0d98f2a507e67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:39.139951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.140797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.145408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 821/1658] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:38 2022] DELETE /identity/v3/projects/22c95afaefe14fff9b0d98f2a507e67f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:39.153951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:39.155657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:39.223938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:39.291911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:39.343658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:39.344618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:39.345140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:39.345641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:39.347028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:39.350380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:39.371546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 838/1659] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:39.372733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:39.374707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:39.418592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38045e-a1b6-436a-ad03-682c7b9e1e8f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:39.432602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571481f-81a8-40b6-a426-a4a08054f308 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:39.438738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:39.439511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:39.439967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:39.440284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] PATH_INFO: `/v3/users/b733f45e1da042b092beb8d7fb417680` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:39.441904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b733f45e1da042b092beb8d7fb417680)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:39.445041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:39.452199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:39.453411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:39.453778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:39.454253 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] PATH_INFO: `/v3/users/4deeb8a13f9e4abca719f2a271a62ed5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:39.456725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4deeb8a13f9e4abca719f2a271a62ed5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:39.460707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:39.575615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b733f45e1da042b092beb8d7fb417680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.586866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4deeb8a13f9e4abca719f2a271a62ed5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.604657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b733f45e1da042b092beb8d7fb417680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.605951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b733f45e1da042b092beb8d7fb417680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.626886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4deeb8a13f9e4abca719f2a271a62ed5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.628874 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4deeb8a13f9e4abca719f2a271a62ed5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.630766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b733f45e1da042b092beb8d7fb417680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.631671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b733f45e1da042b092beb8d7fb417680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.647935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4deeb8a13f9e4abca719f2a271a62ed5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.649353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-669a766b-496b-4b8f-9af0-9438f35fb233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4deeb8a13f9e4abca719f2a271a62ed5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:39.661198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 839/1660] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:39 2022] DELETE /identity/v3/users/b733f45e1da042b092beb8d7fb417680 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:39.663078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:39.664948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:39.689399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 822/1661] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:39 2022] DELETE /identity/v3/users/4deeb8a13f9e4abca719f2a271a62ed5 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:39.690986 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ca54-e634-474b-92f8-e3e9e22529b9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:39.691280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ca54-e634-474b-92f8-e3e9e22529b9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:39.691561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ca54-e634-474b-92f8-e3e9e22529b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:39.746935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dad2ca54-e634-474b-92f8-e3e9e22529b9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:39.748428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dad2ca54-e634-474b-92f8-e3e9e22529b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:39.831781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26532687-30b3-4f48-b9c9-b974d733b551 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:39.928576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:39.936182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:39.937938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:39.938222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:39.938646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] PATH_INFO: `/v3/projects/6e6aa59f8ba84bf0aa876a2f6dd1559c/users/65de81b6c1fa41d39f69b79ce861c68a/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:39.940270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 823/1662] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:39.970828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6aa59f8ba84bf0aa876a2f6dd1559c, user_id=65de81b6c1fa41d39f69b79ce861c68a, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:39.974388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:39.997342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 840/1663] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:39 2022] PUT /identity/v3/projects/6e6aa59f8ba84bf0aa876a2f6dd1559c/users/65de81b6c1fa41d39f69b79ce861c68a/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:40.010891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128263b-4b9b-4ca0-8ae9-0cf0c7b3e98e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:40.011365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128263b-4b9b-4ca0-8ae9-0cf0c7b3e98e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:40.011790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128263b-4b9b-4ca0-8ae9-0cf0c7b3e98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:40.095312 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7128263b-4b9b-4ca0-8ae9-0cf0c7b3e98e None None] MFA Rules not processed for user `65de81b6c1fa41d39f69b79ce861c68a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:40.104663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7128263b-4b9b-4ca0-8ae9-0cf0c7b3e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:40.108830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:40.111078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:40.188155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:40.342796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21dfb8-5363-48eb-a55f-105a70d1168b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:40.353367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 824/1664] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:40.357288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128263b-4b9b-4ca0-8ae9-0cf0c7b3e98e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:40.361591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7128263b-4b9b-4ca0-8ae9-0cf0c7b3e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:40.367672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925774fb-6753-4f7e-9d8d-0665cbab72b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:40.368446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925774fb-6753-4f7e-9d8d-0665cbab72b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:40.369822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925774fb-6753-4f7e-9d8d-0665cbab72b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:40.369822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925774fb-6753-4f7e-9d8d-0665cbab72b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:40.564590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128263b-4b9b-4ca0-8ae9-0cf0c7b3e98e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:40.590585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05684c-c5e5-4d3d-ab4b-558d52df523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:40.592745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05684c-c5e5-4d3d-ab4b-558d52df523b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:40.593065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05684c-c5e5-4d3d-ab4b-558d52df523b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:40.593347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05684c-c5e5-4d3d-ab4b-558d52df523b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:40.601664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925774fb-6753-4f7e-9d8d-0665cbab72b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:40.603231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925774fb-6753-4f7e-9d8d-0665cbab72b1 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:40.608882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05684c-c5e5-4d3d-ab4b-558d52df523b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:40.622119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05684c-c5e5-4d3d-ab4b-558d52df523b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:40.657765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 841/1665] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 11:59:40.697603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 825/1666] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:40 2022] POST /identity/v3/projects => generated 381 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:40.701482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925774fb-6753-4f7e-9d8d-0665cbab72b1 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:40.716674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925774fb-6753-4f7e-9d8d-0665cbab72b1 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:40.888365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137bf2e-03ca-42b9-acb7-6e764cd1e14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:40.889010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137bf2e-03ca-42b9-acb7-6e764cd1e14d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:40.889302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137bf2e-03ca-42b9-acb7-6e764cd1e14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:40.889578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137bf2e-03ca-42b9-acb7-6e764cd1e14d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:40.890233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137bf2e-03ca-42b9-acb7-6e764cd1e14d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:40.892343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137bf2e-03ca-42b9-acb7-6e764cd1e14d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:40.979305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 842/1667] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:40 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:40.981464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05684c-c5e5-4d3d-ab4b-558d52df523b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:40.996413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05684c-c5e5-4d3d-ab4b-558d52df523b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:41.001936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9091-9519-41df-a4ae-9617277bbd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:41.003324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9091-9519-41df-a4ae-9617277bbd3e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:41.003771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9091-9519-41df-a4ae-9617277bbd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:41.004301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9091-9519-41df-a4ae-9617277bbd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:41.005802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec9091-9519-41df-a4ae-9617277bbd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:41.007788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec9091-9519-41df-a4ae-9617277bbd3e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:41.024428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 826/1668] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:41.029068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137bf2e-03ca-42b9-acb7-6e764cd1e14d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:41.045857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137bf2e-03ca-42b9-acb7-6e764cd1e14d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:41.061158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d5593-1aab-42c4-abbd-52bc7af4d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:41.061856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5593-1aab-42c4-abbd-52bc7af4d9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:41.062137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5593-1aab-42c4-abbd-52bc7af4d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:41.062412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5593-1aab-42c4-abbd-52bc7af4d9f8 admin admin] PATH_INFO: `/v3/projects/a5ffbb6b6cc64ba49d22da5f71dc96fd/users/fc78ff1011f344e5b3015b300dfc1d00/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:41.098565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d5593-1aab-42c4-abbd-52bc7af4d9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ffbb6b6cc64ba49d22da5f71dc96fd, user_id=fc78ff1011f344e5b3015b300dfc1d00, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:41.105791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d5593-1aab-42c4-abbd-52bc7af4d9f8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:41.118696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:41.161490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9091-9519-41df-a4ae-9617277bbd3e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:41.173991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 843/1669] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:41 2022] PUT /identity/v3/projects/a5ffbb6b6cc64ba49d22da5f71dc96fd/users/fc78ff1011f344e5b3015b300dfc1d00/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:59:41.187708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9091-9519-41df-a4ae-9617277bbd3e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:41.343676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9809d4-3919-42a1-b26a-b56e4a75c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:41.344413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9809d4-3919-42a1-b26a-b56e4a75c904 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:41.344769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9809d4-3919-42a1-b26a-b56e4a75c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:41.345156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9809d4-3919-42a1-b26a-b56e4a75c904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:41.345884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9809d4-3919-42a1-b26a-b56e4a75c904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:41.347624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9809d4-3919-42a1-b26a-b56e4a75c904 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:41.364433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 827/1670] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:41.365009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d5593-1aab-42c4-abbd-52bc7af4d9f8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:41.394114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d5593-1aab-42c4-abbd-52bc7af4d9f8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:41.414356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:41.415522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:41.415972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:41.416412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] PATH_INFO: `/v3/projects/a5ffbb6b6cc64ba49d22da5f71dc96fd/users/fc78ff1011f344e5b3015b300dfc1d00/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:41.421814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ffbb6b6cc64ba49d22da5f71dc96fd, user_id=fc78ff1011f344e5b3015b300dfc1d00, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:41.453708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:41.485869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 844/1671] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:41 2022] PUT /identity/v3/projects/a5ffbb6b6cc64ba49d22da5f71dc96fd/users/fc78ff1011f344e5b3015b300dfc1d00/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:59:41.497548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789252d9-eeac-421d-822e-949bc7e80fcf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:41.497870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789252d9-eeac-421d-822e-949bc7e80fcf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:41.498125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789252d9-eeac-421d-822e-949bc7e80fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:41.610168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-789252d9-eeac-421d-822e-949bc7e80fcf None None] MFA Rules not processed for user `fc78ff1011f344e5b3015b300dfc1d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:41.620887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-789252d9-eeac-421d-822e-949bc7e80fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:41.678007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:41.868654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 828/1672] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:41.954471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:41.957802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:42.191295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd34dfa-073e-43b4-850e-fb770a9a5727 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:42.197198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f38b6c-e33b-4778-b318-e8288a77a841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:42.197987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f38b6c-e33b-4778-b318-e8288a77a841 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:42.198338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f38b6c-e33b-4778-b318-e8288a77a841 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:42.198677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f38b6c-e33b-4778-b318-e8288a77a841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:42.223703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f38b6c-e33b-4778-b318-e8288a77a841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:42.225277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f38b6c-e33b-4778-b318-e8288a77a841 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:42.269153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 845/1673] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:42.359932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789252d9-eeac-421d-822e-949bc7e80fcf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:42.361458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-789252d9-eeac-421d-822e-949bc7e80fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:42.414378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f38b6c-e33b-4778-b318-e8288a77a841 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:42.425106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f38b6c-e33b-4778-b318-e8288a77a841 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:42.430827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92970e4c-49e4-421d-aaf1-4d621616d1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:42.432001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970e4c-49e4-421d-aaf1-4d621616d1be service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:42.432001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970e4c-49e4-421d-aaf1-4d621616d1be service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:42.432194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92970e4c-49e4-421d-aaf1-4d621616d1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:42.502218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789252d9-eeac-421d-822e-949bc7e80fcf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:42.521024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:42.521724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:42.521983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:42.522260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] PATH_INFO: `/v3/projects/2340216440324735b210103d1ecf4434` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:42.523464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2340216440324735b210103d1ecf4434)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:42.525507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:42.531850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92970e4c-49e4-421d-aaf1-4d621616d1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:42.534137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92970e4c-49e4-421d-aaf1-4d621616d1be service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:42.548425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 846/1674] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 11:59:42.629887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2340216440324735b210103d1ecf4434', 'request_id': 'req-fca2c597-e458-440a-b35a-5285ea541743'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:42.648640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2340216440324735b210103d1ecf4434', 'request_id': 'req-fca2c597-e458-440a-b35a-5285ea541743'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:42.665636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2340216440324735b210103d1ecf4434', 'request_id': 'req-fca2c597-e458-440a-b35a-5285ea541743'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:42.693053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] The token cache is being invalidate because project 2340216440324735b210103d1ecf4434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:42.693346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:42.694217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fca2c597-e458-440a-b35a-5285ea541743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:42.696166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 829/1675] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:42 2022] DELETE /identity/v3/projects/2340216440324735b210103d1ecf4434 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:42.701163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c86c33-b122-40af-ab22-9378e56c5cb3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:42.701449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c86c33-b122-40af-ab22-9378e56c5cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:42.701744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c86c33-b122-40af-ab22-9378e56c5cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:42.742051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-11c86c33-b122-40af-ab22-9378e56c5cb3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:42.746185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11c86c33-b122-40af-ab22-9378e56c5cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:42.927976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 847/1676] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:42.939134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc6bc-4f06-447e-8c5c-24306346218c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:42.939529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc6bc-4f06-447e-8c5c-24306346218c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:42.939806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc6bc-4f06-447e-8c5c-24306346218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.022520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ce2cc6bc-4f06-447e-8c5c-24306346218c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:43.034430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce2cc6bc-4f06-447e-8c5c-24306346218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:43.084706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 830/1677] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:43.089716 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c86c33-b122-40af-ab22-9378e56c5cb3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:43.104229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c86c33-b122-40af-ab22-9378e56c5cb3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:43.119171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:43.119980 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.120362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.121005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.122008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:43.124187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:43.126056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:43.150653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc6bc-4f06-447e-8c5c-24306346218c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:43.151160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 848/1678] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:43.162503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc6bc-4f06-447e-8c5c-24306346218c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:43.177944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:43.179396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.181509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.181989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.182942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:43.210222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:43.309067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 831/1679] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:43 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:59:43.312002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:43.342610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a925b2-d82f-4a8f-adc0-871fbac9116f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:43.360708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:43.443868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:43.446371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:43.477565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba3815-d434-40c3-9a51-411882e88bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:43.478305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba3815-d434-40c3-9a51-411882e88bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.478686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba3815-d434-40c3-9a51-411882e88bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.479073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba3815-d434-40c3-9a51-411882e88bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.479839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba3815-d434-40c3-9a51-411882e88bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:43.488646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba3815-d434-40c3-9a51-411882e88bc9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:43.507827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:43.539212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 849/1680] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:43 2022] POST /identity/v3/users => generated 284 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:43.545248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba3815-d434-40c3-9a51-411882e88bc9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:43.575055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba3815-d434-40c3-9a51-411882e88bc9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:43.590556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748651d7-2648-48cd-b97d-9801c2f53f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:43.593491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748651d7-2648-48cd-b97d-9801c2f53f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.593669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748651d7-2648-48cd-b97d-9801c2f53f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.593947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748651d7-2648-48cd-b97d-9801c2f53f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.597195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748651d7-2648-48cd-b97d-9801c2f53f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:43.604761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748651d7-2648-48cd-b97d-9801c2f53f49 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:43.624829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ff956-619b-4fb2-b593-09c5c22f3702 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:43.650019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:43.650019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.650019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.650019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] PATH_INFO: `/v3/projects/d65be4969def472dba8adae669b7e2a7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.650651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 850/1681] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:43.652034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748651d7-2648-48cd-b97d-9801c2f53f49 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:43.653837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65be4969def472dba8adae669b7e2a7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:43.660191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:43.684029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748651d7-2648-48cd-b97d-9801c2f53f49 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:43.697710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746d0b-9a2b-450e-9b58-60ec0df5beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:43.702743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746d0b-9a2b-450e-9b58-60ec0df5beb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.702995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746d0b-9a2b-450e-9b58-60ec0df5beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.703139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d746d0b-9a2b-450e-9b58-60ec0df5beb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.703799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d746d0b-9a2b-450e-9b58-60ec0df5beb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:43.705937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d746d0b-9a2b-450e-9b58-60ec0df5beb2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:43.730263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 851/1682] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:43.734990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746d0b-9a2b-450e-9b58-60ec0df5beb2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:43.765258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d746d0b-9a2b-450e-9b58-60ec0df5beb2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:43.776588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8dc27-9cd8-4466-ae72-620c090fe43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:43.777773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8dc27-9cd8-4466-ae72-620c090fe43d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.778169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8dc27-9cd8-4466-ae72-620c090fe43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.779019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8dc27-9cd8-4466-ae72-620c090fe43d admin admin] PATH_INFO: `/v3/projects/07f2a3bcbe4c477b91598c8bcbe7e691/users/c76d017d2acb470c9a81ca84ca28f101/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.807435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65be4969def472dba8adae669b7e2a7', 'request_id': 'req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:43.814513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8dc27-9cd8-4466-ae72-620c090fe43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f2a3bcbe4c477b91598c8bcbe7e691, user_id=c76d017d2acb470c9a81ca84ca28f101, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:43.818309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65be4969def472dba8adae669b7e2a7', 'request_id': 'req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:43.820789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8dc27-9cd8-4466-ae72-620c090fe43d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:43.826196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65be4969def472dba8adae669b7e2a7', 'request_id': 'req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:43.854232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 852/1683] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:43 2022] PUT /identity/v3/projects/07f2a3bcbe4c477b91598c8bcbe7e691/users/c76d017d2acb470c9a81ca84ca28f101/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:59:43.869294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] The token cache is being invalidate because project d65be4969def472dba8adae669b7e2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:43.870286 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:43.872297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c9e69837-a0f6-41a7-8fe1-dd4e88ce6181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:43.875874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6825b18-762a-4450-9df1-60fdfe2b80c2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.875874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6825b18-762a-4450-9df1-60fdfe2b80c2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.875874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6825b18-762a-4450-9df1-60fdfe2b80c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.881026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 832/1684] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:43 2022] DELETE /identity/v3/projects/d65be4969def472dba8adae669b7e2a7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 11:59:43.882360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf03a-7ae4-489d-872e-691bfe568b87 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:43.882952 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf03a-7ae4-489d-872e-691bfe568b87 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:43.883070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf03a-7ae4-489d-872e-691bfe568b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:43.944781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-886bf03a-7ae4-489d-872e-691bfe568b87 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:43.947213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-886bf03a-7ae4-489d-872e-691bfe568b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:43.961056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b6825b18-762a-4450-9df1-60fdfe2b80c2 None None] MFA Rules not processed for user `c76d017d2acb470c9a81ca84ca28f101`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:43.962700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b6825b18-762a-4450-9df1-60fdfe2b80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:44.088539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 833/1685] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:44.104047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ed9d8-9314-41d9-95eb-e64183bad5de None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.104516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ed9d8-9314-41d9-95eb-e64183bad5de None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.105416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ed9d8-9314-41d9-95eb-e64183bad5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.156286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 853/1686] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:44.161855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6825b18-762a-4450-9df1-60fdfe2b80c2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:44.163357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b6825b18-762a-4450-9df1-60fdfe2b80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:44.169956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-181ed9d8-9314-41d9-95eb-e64183bad5de None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:44.174051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-181ed9d8-9314-41d9-95eb-e64183bad5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:44.194988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 834/1687] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:44.198775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ed9d8-9314-41d9-95eb-e64183bad5de None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:44.199372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6825b18-762a-4450-9df1-60fdfe2b80c2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:44.210425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccc639-e923-4a2a-9444-48fdce3a70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:44.212820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccc639-e923-4a2a-9444-48fdce3a70de admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.213681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccc639-e923-4a2a-9444-48fdce3a70de admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.213964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccc639-e923-4a2a-9444-48fdce3a70de admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.214678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccc639-e923-4a2a-9444-48fdce3a70de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:44.218041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccc639-e923-4a2a-9444-48fdce3a70de admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:44.224181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ed9d8-9314-41d9-95eb-e64183bad5de None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:44.239597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:44.243543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.244341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.254333 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.256736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:44.258367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:44.263301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:44.275490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 854/1688] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:44 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:59:44.276683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccc639-e923-4a2a-9444-48fdce3a70de admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:44.296715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 835/1689] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 11:59:44.303145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:44.327452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e64920-37f4-4970-9380-16a151058fb4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:44.346498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:44.422301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:44.482363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ec0ef-5a8f-48d5-bbc3-8e6a9bb75a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:44.483568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec0ef-5a8f-48d5-bbc3-8e6a9bb75a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.483970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec0ef-5a8f-48d5-bbc3-8e6a9bb75a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.484353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ec0ef-5a8f-48d5-bbc3-8e6a9bb75a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.485195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ec0ef-5a8f-48d5-bbc3-8e6a9bb75a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:44.487573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccc639-e923-4a2a-9444-48fdce3a70de admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:44.488458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ec0ef-5a8f-48d5-bbc3-8e6a9bb75a1c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:44.505036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c680-0893-4fb6-953b-dce397ee0e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:44.505848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c680-0893-4fb6-953b-dce397ee0e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.506616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c680-0893-4fb6-953b-dce397ee0e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.507827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c680-0893-4fb6-953b-dce397ee0e43 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.508847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6c680-0893-4fb6-953b-dce397ee0e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:44.511083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6c680-0893-4fb6-953b-dce397ee0e43 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:44.562175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 836/1690] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:44 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:44.563294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ec0ef-5a8f-48d5-bbc3-8e6a9bb75a1c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:44.579576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 855/1691] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:44 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:44.584590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c680-0893-4fb6-953b-dce397ee0e43 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:44.610854 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6c680-0893-4fb6-953b-dce397ee0e43 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:44.704306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ec0ef-5a8f-48d5-bbc3-8e6a9bb75a1c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:44.712324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a90dc-9c4c-449f-99b6-c893fefad497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:44.712953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a90dc-9c4c-449f-99b6-c893fefad497 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.713256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a90dc-9c4c-449f-99b6-c893fefad497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.713526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a90dc-9c4c-449f-99b6-c893fefad497 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.714168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a90dc-9c4c-449f-99b6-c893fefad497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:44.718088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a90dc-9c4c-449f-99b6-c893fefad497 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:44.772161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 837/1692] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:44 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 11:59:44.786550 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a90dc-9c4c-449f-99b6-c893fefad497 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:44.810855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685131fb-0997-4779-9f3e-a9f672d3e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:44.811493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685131fb-0997-4779-9f3e-a9f672d3e063 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.811783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685131fb-0997-4779-9f3e-a9f672d3e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.812086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685131fb-0997-4779-9f3e-a9f672d3e063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.812710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685131fb-0997-4779-9f3e-a9f672d3e063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:44.814333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685131fb-0997-4779-9f3e-a9f672d3e063 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:44.845006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a90dc-9c4c-449f-99b6-c893fefad497 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:44.864533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe658b-b7d6-4a0e-b4a2-3f87af9b393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:44.865187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe658b-b7d6-4a0e-b4a2-3f87af9b393d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.865472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe658b-b7d6-4a0e-b4a2-3f87af9b393d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.865747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe658b-b7d6-4a0e-b4a2-3f87af9b393d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.866402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe658b-b7d6-4a0e-b4a2-3f87af9b393d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:44.881439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe658b-b7d6-4a0e-b4a2-3f87af9b393d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:44.883129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 856/1693] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:44.889559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3974-4bc9-4ad1-83db-a7310c70c9b3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:44.889848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3974-4bc9-4ad1-83db-a7310c70c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:44.890114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d3974-4bc9-4ad1-83db-a7310c70c9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:44.927187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 838/1694] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:44.945326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe658b-b7d6-4a0e-b4a2-3f87af9b393d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:44.986103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe658b-b7d6-4a0e-b4a2-3f87af9b393d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:45.008531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78af784-4411-45e5-90ab-fd618ce75c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:45.009257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78af784-4411-45e5-90ab-fd618ce75c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.009541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78af784-4411-45e5-90ab-fd618ce75c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.009820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78af784-4411-45e5-90ab-fd618ce75c4a admin admin] PATH_INFO: `/v3/projects/9b7f2bc5ec714cbf924be4e77594597b/users/719e8df7a9934c4bb0c0c8ef217300c6/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.011541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-481d3974-4bc9-4ad1-83db-a7310c70c9b3 None None] MFA Rules not processed for user `8fdf7fcf986c43b895e4c76c4dd2adff`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:45.012767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-481d3974-4bc9-4ad1-83db-a7310c70c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:45.062694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78af784-4411-45e5-90ab-fd618ce75c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7f2bc5ec714cbf924be4e77594597b, user_id=719e8df7a9934c4bb0c0c8ef217300c6, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:45.063050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78af784-4411-45e5-90ab-fd618ce75c4a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:45.113643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 839/1695] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:44 2022] PUT /identity/v3/projects/9b7f2bc5ec714cbf924be4e77594597b/users/719e8df7a9934c4bb0c0c8ef217300c6/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:45.115369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78af784-4411-45e5-90ab-fd618ce75c4a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:45.220210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 857/1696] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:45.231980 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d3974-4bc9-4ad1-83db-a7310c70c9b3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:45.248917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d3974-4bc9-4ad1-83db-a7310c70c9b3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:45.264040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78af784-4411-45e5-90ab-fd618ce75c4a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:45.266381 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d6bd7-3c77-4bd0-ab07-ca3f61c77838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:45.267019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6bd7-3c77-4bd0-ab07-ca3f61c77838 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.267300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6bd7-3c77-4bd0-ab07-ca3f61c77838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.267575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6bd7-3c77-4bd0-ab07-ca3f61c77838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.268840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d6bd7-3c77-4bd0-ab07-ca3f61c77838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:45.271274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d6bd7-3c77-4bd0-ab07-ca3f61c77838 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:45.280288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254f90a-856b-4a1a-a17a-90846ccbd52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:45.281217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f90a-856b-4a1a-a17a-90846ccbd52f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.281841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f90a-856b-4a1a-a17a-90846ccbd52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.283162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254f90a-856b-4a1a-a17a-90846ccbd52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.284585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254f90a-856b-4a1a-a17a-90846ccbd52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:45.289851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254f90a-856b-4a1a-a17a-90846ccbd52f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:45.305275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 858/1697] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:45.313373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2611a8-5ead-483f-8047-56b0e9e69e77 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.314132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2611a8-5ead-483f-8047-56b0e9e69e77 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.314416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2611a8-5ead-483f-8047-56b0e9e69e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.326929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 840/1698] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:45.329365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254f90a-856b-4a1a-a17a-90846ccbd52f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:45.351713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254f90a-856b-4a1a-a17a-90846ccbd52f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:45.358226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bf12-8076-456c-ae12-58fcc9e9d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:45.359186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bf12-8076-456c-ae12-58fcc9e9d836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.359485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bf12-8076-456c-ae12-58fcc9e9d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.359811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bf12-8076-456c-ae12-58fcc9e9d836 admin admin] PATH_INFO: `/v3/projects/9b7f2bc5ec714cbf924be4e77594597b/users/719e8df7a9934c4bb0c0c8ef217300c6/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.362513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806bf12-8076-456c-ae12-58fcc9e9d836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7f2bc5ec714cbf924be4e77594597b, user_id=719e8df7a9934c4bb0c0c8ef217300c6, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:45.365947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806bf12-8076-456c-ae12-58fcc9e9d836 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:45.370700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:45.376647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-da2611a8-5ead-483f-8047-56b0e9e69e77 None None] MFA Rules not processed for user `8fdf7fcf986c43b895e4c76c4dd2adff`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:45.381692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-da2611a8-5ead-483f-8047-56b0e9e69e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:45.388387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 841/1699] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:45 2022] PUT /identity/v3/projects/9b7f2bc5ec714cbf924be4e77594597b/users/719e8df7a9934c4bb0c0c8ef217300c6/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:45.402884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bf12-8076-456c-ae12-58fcc9e9d836 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:45.514060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:45.621848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bf12-8076-456c-ae12-58fcc9e9d836 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:45.648188 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:45.650503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.650503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.657231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] PATH_INFO: `/v3/projects/62ec5830b9f442e0994ea5bdde4c3549/users/7b5bfb94aeaf419a9e7035c83f004bdf/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.662067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 859/1700] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:45.667005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693fee-d783-48f6-8a9e-f1d160adfbef None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.667948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693fee-d783-48f6-8a9e-f1d160adfbef None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.667948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98693fee-d783-48f6-8a9e-f1d160adfbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.686806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ec5830b9f442e0994ea5bdde4c3549, user_id=7b5bfb94aeaf419a9e7035c83f004bdf, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:45.691088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:45.719706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 842/1701] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:45 2022] PUT /identity/v3/projects/62ec5830b9f442e0994ea5bdde4c3549/users/7b5bfb94aeaf419a9e7035c83f004bdf/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:45.720478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:45.722715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:45.744807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-98693fee-d783-48f6-8a9e-f1d160adfbef None None] MFA Rules not processed for user `719e8df7a9934c4bb0c0c8ef217300c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:45.746111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-98693fee-d783-48f6-8a9e-f1d160adfbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:45.853376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae96eec-aa59-47a9-8ab3-95061d2cb4b8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:45.859780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:45.860797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.861124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.861706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:45.962879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 860/1702] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:45.962879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb67d0f-48c9-4a01-a910-7dc7901b0794 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:45.962879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb67d0f-48c9-4a01-a910-7dc7901b0794 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:45.962879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb67d0f-48c9-4a01-a910-7dc7901b0794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:46.015763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:46.018076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:46.051050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 843/1703] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:46.051637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:46.053360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:46.067167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ebb67d0f-48c9-4a01-a910-7dc7901b0794 None None] MFA Rules not processed for user `7b5bfb94aeaf419a9e7035c83f004bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:46.068686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ebb67d0f-48c9-4a01-a910-7dc7901b0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:46.087701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:46.195324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d3d7a-19c5-490f-b1a5-2a62ec0c9850 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:46.212023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:46.213110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:46.213110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:46.216009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:46.247079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:46.251658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:46.261371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 861/1704] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:46.268601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb67d0f-48c9-4a01-a910-7dc7901b0794 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:46.270435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ebb67d0f-48c9-4a01-a910-7dc7901b0794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:46.292618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 844/1705] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:46.309113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb67d0f-48c9-4a01-a910-7dc7901b0794 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:46.321134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a7e8e-8fc1-4a0e-8c41-720551f9dcd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:46.321990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7e8e-8fc1-4a0e-8c41-720551f9dcd4 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:46.323558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7e8e-8fc1-4a0e-8c41-720551f9dcd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:46.325586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7e8e-8fc1-4a0e-8c41-720551f9dcd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:46.359242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a7e8e-8fc1-4a0e-8c41-720551f9dcd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:46.360874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a7e8e-8fc1-4a0e-8c41-720551f9dcd4 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:46.396643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 862/1706] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 11:59:46.457928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:46.460086 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:46.690289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef00710-a05b-4170-b344-7b27d661ffb5 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:46.705466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:46.706884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:46.707239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:46.707518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] PATH_INFO: `/v3/users/e943ed71010244489363229028cf6acf` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:46.708819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e943ed71010244489363229028cf6acf)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:46.716046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:46.853775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e943ed71010244489363229028cf6acf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:46.894615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e943ed71010244489363229028cf6acf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:46.897082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e943ed71010244489363229028cf6acf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:46.923712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e943ed71010244489363229028cf6acf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:46.925347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e943ed71010244489363229028cf6acf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:46.971620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 845/1707] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:46 2022] DELETE /identity/v3/users/e943ed71010244489363229028cf6acf => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:46.974110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984057c-07c2-42a5-b0b2-f5c9f391aecc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:46.974506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984057c-07c2-42a5-b0b2-f5c9f391aecc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:46.974895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984057c-07c2-42a5-b0b2-f5c9f391aecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:47.023027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0984057c-07c2-42a5-b0b2-f5c9f391aecc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:47.028863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0984057c-07c2-42a5-b0b2-f5c9f391aecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:47.166180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:47.298416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 863/1708] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:47.342670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:47.346984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:47.375062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1e17-7e3b-48e8-a4bc-f96feb452646 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:47.375582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1e17-7e3b-48e8-a4bc-f96feb452646 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:47.376041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1e17-7e3b-48e8-a4bc-f96feb452646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:47.465112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-353e1e17-7e3b-48e8-a4bc-f96feb452646 None None] MFA Rules not processed for user `5d6271f24cdc4a5094c1bb654d524eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:47.466522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-353e1e17-7e3b-48e8-a4bc-f96feb452646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:47.475360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:47.523760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e318-9f22-4a8b-9d99-b070a9e00500 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:47.568180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c8009-9dee-4a67-9dfc-802105457441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:47.570057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c8009-9dee-4a67-9dfc-802105457441 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:47.570351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c8009-9dee-4a67-9dfc-802105457441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:47.575940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c8009-9dee-4a67-9dfc-802105457441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:47.602590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c8009-9dee-4a67-9dfc-802105457441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:47.604572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c8009-9dee-4a67-9dfc-802105457441 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:47.649852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 846/1709] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:47.693844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 864/1710] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:47.695244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e18e3-3d36-4ecc-a4d7-f348a607b667 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:47.695682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e18e3-3d36-4ecc-a4d7-f348a607b667 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:47.695797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e18e3-3d36-4ecc-a4d7-f348a607b667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:47.731434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c69e18e3-3d36-4ecc-a4d7-f348a607b667 None None] MFA Rules not processed for user `5d6271f24cdc4a5094c1bb654d524eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:47.733051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c69e18e3-3d36-4ecc-a4d7-f348a607b667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:47.751399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 847/1711] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:47.758215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e1e17-7e3b-48e8-a4bc-f96feb452646 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:47.760688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-353e1e17-7e3b-48e8-a4bc-f96feb452646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:47.952450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e1e17-7e3b-48e8-a4bc-f96feb452646 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:47.960283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562181b-aee1-4f32-9afc-77859b7de67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:47.960951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562181b-aee1-4f32-9afc-77859b7de67e service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:47.961324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562181b-aee1-4f32-9afc-77859b7de67e service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:47.961661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562181b-aee1-4f32-9afc-77859b7de67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:47.965109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774d888-5bd9-41cb-81d9-a6575ed21db4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:47.965356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774d888-5bd9-41cb-81d9-a6575ed21db4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:47.965913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774d888-5bd9-41cb-81d9-a6575ed21db4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:47.967967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 848/1712] 10.222.0.45 () {54 vars in 912 bytes} [Mon Oct 10 11:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 10 11:59:47.975377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca909ed-c1e0-4cc2-92ca-879dc256db3a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:47.975850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca909ed-c1e0-4cc2-92ca-879dc256db3a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:47.976326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca909ed-c1e0-4cc2-92ca-879dc256db3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:47.982132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562181b-aee1-4f32-9afc-77859b7de67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:47.984381 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562181b-aee1-4f32-9afc-77859b7de67e service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:48.014556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 865/1713] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:48.102349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8ca909ed-c1e0-4cc2-92ca-879dc256db3a None None] MFA Rules not processed for user `3a1f548368994994a2966b7818e8b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:48.107892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8ca909ed-c1e0-4cc2-92ca-879dc256db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:48.129588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 849/1714] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 11:59:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:48.171782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562181b-aee1-4f32-9afc-77859b7de67e service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:48.184769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562181b-aee1-4f32-9afc-77859b7de67e service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:48.200289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612587a-58de-416e-8094-13b2b15e2303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:48.203780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612587a-58de-416e-8094-13b2b15e2303 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:48.204161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612587a-58de-416e-8094-13b2b15e2303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:48.205123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612587a-58de-416e-8094-13b2b15e2303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:48.226159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3b4e-3012-490c-a616-dfd4c4d85309 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:48.226456 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3b4e-3012-490c-a616-dfd4c4d85309 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:48.226853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3b4e-3012-490c-a616-dfd4c4d85309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:48.233886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612587a-58de-416e-8094-13b2b15e2303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:48.251413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612587a-58de-416e-8094-13b2b15e2303 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:48.285966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 866/1715] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:48.304171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-09da3b4e-3012-490c-a616-dfd4c4d85309 None None] MFA Rules not processed for user `912b5f1275fb43dfb1c0a9c47ecb3fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:48.306542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-09da3b4e-3012-490c-a616-dfd4c4d85309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:48.492565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 850/1716] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:48.765021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c26d4-bb55-451e-8ef0-94c032e226f7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:48.766080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c26d4-bb55-451e-8ef0-94c032e226f7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:48.766501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c26d4-bb55-451e-8ef0-94c032e226f7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:48.769507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 867/1717] 10.222.0.45 () {54 vars in 912 bytes} [Mon Oct 10 11:59:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:48.782542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6625-7f09-44c3-92fe-7b741efaf022 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:48.783465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6625-7f09-44c3-92fe-7b741efaf022 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:48.784997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e6625-7f09-44c3-92fe-7b741efaf022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:48.824903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7a3e6625-7f09-44c3-92fe-7b741efaf022 None None] MFA Rules not processed for user `3a1f548368994994a2966b7818e8b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:48.827488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7a3e6625-7f09-44c3-92fe-7b741efaf022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:48.845109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 851/1718] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 11:59:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:48.858759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c26d4-bb55-451e-8ef0-94c032e226f7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:48.862920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-025c26d4-bb55-451e-8ef0-94c032e226f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:48.899048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c26d4-bb55-451e-8ef0-94c032e226f7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:48.915614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:48.919701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:48.920793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:48.921131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:48.944570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:48.946072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:48.977585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 868/1719] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:49.051410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e6625-7f09-44c3-92fe-7b741efaf022 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:49.052877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7a3e6625-7f09-44c3-92fe-7b741efaf022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:49.091251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e6625-7f09-44c3-92fe-7b741efaf022 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:49.108316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:49.109013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:49.109304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:49.109582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] PATH_INFO: `/v3/projects/b9839e69dabd4284ac4204a8138dcff4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:49.116377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9839e69dabd4284ac4204a8138dcff4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:49.125032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:49.287713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9839e69dabd4284ac4204a8138dcff4', 'request_id': 'req-3b60125e-6a71-4097-ac79-2af484ed25fb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:49.298676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9839e69dabd4284ac4204a8138dcff4', 'request_id': 'req-3b60125e-6a71-4097-ac79-2af484ed25fb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:49.310429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9839e69dabd4284ac4204a8138dcff4', 'request_id': 'req-3b60125e-6a71-4097-ac79-2af484ed25fb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:49.360585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] The token cache is being invalidate because project b9839e69dabd4284ac4204a8138dcff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:49.364369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:49.365298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:49.365426 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b60125e-6a71-4097-ac79-2af484ed25fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:49.366720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:49.370907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 852/1720] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:49 2022] DELETE /identity/v3/projects/b9839e69dabd4284ac4204a8138dcff4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:49.377675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0e96-c56e-493f-942a-1891be1c8891 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:49.378202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0e96-c56e-493f-942a-1891be1c8891 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:49.379031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0e96-c56e-493f-942a-1891be1c8891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:49.397793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6484640-de8f-418b-91bb-796db6b07380 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:49.411613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-366a0e96-c56e-493f-942a-1891be1c8891 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:49.413116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-366a0e96-c56e-493f-942a-1891be1c8891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:49.431788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:49.477508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:49.595845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 853/1721] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:49.599144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a0e96-c56e-493f-942a-1891be1c8891 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:49.600853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-366a0e96-c56e-493f-942a-1891be1c8891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:49.652139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad8737-708c-4d72-ba77-be52a6d97b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:49.652767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8737-708c-4d72-ba77-be52a6d97b8d service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:49.653071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8737-708c-4d72-ba77-be52a6d97b8d service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:49.653341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad8737-708c-4d72-ba77-be52a6d97b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:49.660033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-acad8737-708c-4d72-ba77-be52a6d97b8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:49.813942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8737-708c-4d72-ba77-be52a6d97b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:49.821939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad8737-708c-4d72-ba77-be52a6d97b8d service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:49.845746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 869/1722] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 11:59:49.847239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09ad47-446f-4218-a450-e91d14b97e77 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:49.847991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09ad47-446f-4218-a450-e91d14b97e77 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:49.848511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09ad47-446f-4218-a450-e91d14b97e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:49.860163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a0e96-c56e-493f-942a-1891be1c8891 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:49.892157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce3cc-2541-4e6b-aaa8-7f26c79496fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:49.892696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0a09ad47-446f-4218-a450-e91d14b97e77 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:49.893315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce3cc-2541-4e6b-aaa8-7f26c79496fa service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:49.895542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce3cc-2541-4e6b-aaa8-7f26c79496fa service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:49.896002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0a09ad47-446f-4218-a450-e91d14b97e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:49.896346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce3cc-2541-4e6b-aaa8-7f26c79496fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:49.902702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f65ce3cc-2541-4e6b-aaa8-7f26c79496fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:49.907239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 870/1723] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:49.908792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc965c-9486-4699-8af3-60369a66ab02 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:49.909611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc965c-9486-4699-8af3-60369a66ab02 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:49.910024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc965c-9486-4699-8af3-60369a66ab02 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:49.911445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 871/1724] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 10 11:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 11:59:49.920296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc965c-9486-4699-8af3-60369a66ab02 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:49.931361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce3cc-2541-4e6b-aaa8-7f26c79496fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:49.934098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce3cc-2541-4e6b-aaa8-7f26c79496fa service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:49.944039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc965c-9486-4699-8af3-60369a66ab02 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:49.950380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:49.951368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:49.951851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:49.952267 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:49.953381 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:49.953897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:49.956645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:49.960242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 854/1725] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:49.964168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8b65-d014-4469-82d2-9a9283a3ec2a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:49.964619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8b65-d014-4469-82d2-9a9283a3ec2a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:49.965763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d8b65-d014-4469-82d2-9a9283a3ec2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:49.996639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 872/1726] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:50.001120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:50.027887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058eebf-5fb0-44e7-bc03-5505ac586afe admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:50.039180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bb0d8b65-d014-4469-82d2-9a9283a3ec2a None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:50.039799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92430892-f6aa-431b-89a8-8c58b0414a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:50.040428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430892-f6aa-431b-89a8-8c58b0414a9b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.040711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430892-f6aa-431b-89a8-8c58b0414a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.041105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430892-f6aa-431b-89a8-8c58b0414a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.041668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92430892-f6aa-431b-89a8-8c58b0414a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:50.043435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bb0d8b65-d014-4469-82d2-9a9283a3ec2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:50.048171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92430892-f6aa-431b-89a8-8c58b0414a9b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:50.076709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 855/1727] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 10 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:50.084809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8b65-d014-4469-82d2-9a9283a3ec2a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:50.126046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d8b65-d014-4469-82d2-9a9283a3ec2a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:50.146468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2597805-94a0-4226-a170-4f73f1ee32e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:50.148222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 873/1728] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:50 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:50.149166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92430892-f6aa-431b-89a8-8c58b0414a9b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:50.149403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2597805-94a0-4226-a170-4f73f1ee32e9 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.149797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2597805-94a0-4226-a170-4f73f1ee32e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.149970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2597805-94a0-4226-a170-4f73f1ee32e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.185280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2597805-94a0-4226-a170-4f73f1ee32e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:50.193277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2597805-94a0-4226-a170-4f73f1ee32e9 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:50.226232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 856/1729] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:50.379884 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92430892-f6aa-431b-89a8-8c58b0414a9b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:50.392040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d2935-9a60-42e3-b217-16928e0f0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:50.392676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d2935-9a60-42e3-b217-16928e0f0eae admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.392958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d2935-9a60-42e3-b217-16928e0f0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.398197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d2935-9a60-42e3-b217-16928e0f0eae admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.399067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d2935-9a60-42e3-b217-16928e0f0eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:50.401248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d2935-9a60-42e3-b217-16928e0f0eae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:50.477817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679406d5-559a-4b3d-a92d-0495b036e659 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.478311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679406d5-559a-4b3d-a92d-0495b036e659 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.478868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679406d5-559a-4b3d-a92d-0495b036e659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.482281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 874/1730] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:50 2022] POST /identity/v3/users => generated 294 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:50.486561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d2935-9a60-42e3-b217-16928e0f0eae admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:50.511456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d2935-9a60-42e3-b217-16928e0f0eae admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:50.540385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56766b6f-83fc-4d43-95e2-a1c2412f9aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:50.541820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766b6f-83fc-4d43-95e2-a1c2412f9aca admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.542497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766b6f-83fc-4d43-95e2-a1c2412f9aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.542497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766b6f-83fc-4d43-95e2-a1c2412f9aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.543137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56766b6f-83fc-4d43-95e2-a1c2412f9aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:50.546078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56766b6f-83fc-4d43-95e2-a1c2412f9aca admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:50.546501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-679406d5-559a-4b3d-a92d-0495b036e659 None None] MFA Rules not processed for user `8fdf7fcf986c43b895e4c76c4dd2adff`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:50.548293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:50.558211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-679406d5-559a-4b3d-a92d-0495b036e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:50.569127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 875/1731] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:50.573042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56766b6f-83fc-4d43-95e2-a1c2412f9aca admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:50.588810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56766b6f-83fc-4d43-95e2-a1c2412f9aca admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:50.595994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d835-44a2-4bf6-95e0-9b2193446aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:50.597684 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d835-44a2-4bf6-95e0-9b2193446aee admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.598332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d835-44a2-4bf6-95e0-9b2193446aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.598805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d835-44a2-4bf6-95e0-9b2193446aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.599822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435d835-44a2-4bf6-95e0-9b2193446aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:50.602291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435d835-44a2-4bf6-95e0-9b2193446aee admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:50.646492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 876/1732] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:50.650804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d835-44a2-4bf6-95e0-9b2193446aee admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:50.685460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d835-44a2-4bf6-95e0-9b2193446aee admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:50.703727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aee1d-4ada-4123-8184-ef0fb613fffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:50.704353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aee1d-4ada-4123-8184-ef0fb613fffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.704639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aee1d-4ada-4123-8184-ef0fb613fffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.704917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aee1d-4ada-4123-8184-ef0fb613fffb admin admin] PATH_INFO: `/v3/projects/4e21855a8476471e94299230f1e87d55/users/3b1c262c80c54351aa7156b180477087/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.790205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aee1d-4ada-4123-8184-ef0fb613fffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e21855a8476471e94299230f1e87d55, user_id=3b1c262c80c54351aa7156b180477087, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:50.793105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aee1d-4ada-4123-8184-ef0fb613fffb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:50.798586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 857/1733] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:50.859709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 877/1734] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:50 2022] PUT /identity/v3/projects/4e21855a8476471e94299230f1e87d55/users/3b1c262c80c54351aa7156b180477087/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:50.871878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4e36-5712-4515-a34d-63ed69bd6fbe None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:50.872529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4e36-5712-4515-a34d-63ed69bd6fbe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:50.873484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4e36-5712-4515-a34d-63ed69bd6fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:50.980718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-70bb4e36-5712-4515-a34d-63ed69bd6fbe None None] MFA Rules not processed for user `3b1c262c80c54351aa7156b180477087`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:50.984983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70bb4e36-5712-4515-a34d-63ed69bd6fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:51.126042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:51.230820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 858/1735] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:51.235602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aee1d-4ada-4123-8184-ef0fb613fffb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:51.482091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aee1d-4ada-4123-8184-ef0fb613fffb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:51.513995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734486a-5f25-4b40-a76e-f6bf9f2d6f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:51.515980 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734486a-5f25-4b40-a76e-f6bf9f2d6f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:51.516268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734486a-5f25-4b40-a76e-f6bf9f2d6f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:51.516549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734486a-5f25-4b40-a76e-f6bf9f2d6f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:51.517272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734486a-5f25-4b40-a76e-f6bf9f2d6f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:51.539841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734486a-5f25-4b40-a76e-f6bf9f2d6f4f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:51.702574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 878/1736] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:51 2022] POST /identity/v3/projects => generated 387 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:51.705300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4e36-5712-4515-a34d-63ed69bd6fbe None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:51.726457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4e36-5712-4515-a34d-63ed69bd6fbe None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:52.084360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:52.088478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:52.092188 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:52.093361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:52.098402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:52.106016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:52.192903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 859/1737] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:51 2022] POST /identity/v3/users => generated 300 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:52.195808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734486a-5f25-4b40-a76e-f6bf9f2d6f4f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:52.215944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734486a-5f25-4b40-a76e-f6bf9f2d6f4f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:52.232826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:52.238018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:52.238388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:52.238751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:52.242651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:52.256994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:52.258444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:52.266543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:52.298912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46282598-8fc9-45b7-b80c-a8e0a5292a51 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:52.328450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:52.329146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:52.329430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:52.329705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] PATH_INFO: `/v3/users/7b5bfb94aeaf419a9e7035c83f004bdf` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:52.331966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 879/1738] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 11:59:52.332845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:52.333947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5bfb94aeaf419a9e7035c83f004bdf)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:52.336019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:52.340086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:52.366760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478b007-f5be-4a51-bfd6-a4dfce632093 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:52.377487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:52.379270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:52.381311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:52.381750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] PATH_INFO: `/v3/users/c76d017d2acb470c9a81ca84ca28f101` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:52.384499 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76d017d2acb470c9a81ca84ca28f101)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:52.391483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:52.466262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5bfb94aeaf419a9e7035c83f004bdf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.515689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5bfb94aeaf419a9e7035c83f004bdf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.519660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5bfb94aeaf419a9e7035c83f004bdf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.550285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5bfb94aeaf419a9e7035c83f004bdf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.551134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5bfb94aeaf419a9e7035c83f004bdf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.561613 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76d017d2acb470c9a81ca84ca28f101'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.592415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 860/1739] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:52 2022] DELETE /identity/v3/users/7b5bfb94aeaf419a9e7035c83f004bdf => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:52.593791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:52.597797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:52.609362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76d017d2acb470c9a81ca84ca28f101'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.614746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76d017d2acb470c9a81ca84ca28f101'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.644321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76d017d2acb470c9a81ca84ca28f101'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.646343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76d017d2acb470c9a81ca84ca28f101'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.674323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 880/1740] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:52 2022] DELETE /identity/v3/users/c76d017d2acb470c9a81ca84ca28f101 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:52.675691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:52.680187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:52.695893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:52.701344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:52.782689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b5eed-76ac-4be6-ad9f-96d0ee993da7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:52.804080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:52.805009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:52.805529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:52.805942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] PATH_INFO: `/v3/users/65de81b6c1fa41d39f69b79ce861c68a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:52.807410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65de81b6c1fa41d39f69b79ce861c68a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:52.809578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:52.829636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bb86b-4d2a-4e8e-888b-3a297678e437 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:52.883273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3b30-bc54-4985-8682-09aec1da5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:52.888196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3b30-bc54-4985-8682-09aec1da5057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:52.891228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3b30-bc54-4985-8682-09aec1da5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:52.891683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3b30-bc54-4985-8682-09aec1da5057 admin admin] PATH_INFO: `/v3/projects/d0f419105f9348498d44b3ce4b0a573c/users/d78a44ea4eda4199b4d96f89f0deb918/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:52.936514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3b30-bc54-4985-8682-09aec1da5057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f419105f9348498d44b3ce4b0a573c, user_id=d78a44ea4eda4199b4d96f89f0deb918, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:52.940615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3b30-bc54-4985-8682-09aec1da5057 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:52.976135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65de81b6c1fa41d39f69b79ce861c68a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:52.995937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 881/1741] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:52 2022] PUT /identity/v3/projects/d0f419105f9348498d44b3ce4b0a573c/users/d78a44ea4eda4199b4d96f89f0deb918/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:52.998433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339834b1-8f1d-4d9a-ab7e-0be3c33be86d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:52.998433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339834b1-8f1d-4d9a-ab7e-0be3c33be86d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.000238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339834b1-8f1d-4d9a-ab7e-0be3c33be86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.031750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65de81b6c1fa41d39f69b79ce861c68a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:53.033191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65de81b6c1fa41d39f69b79ce861c68a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:53.045278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65de81b6c1fa41d39f69b79ce861c68a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:53.046227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92020701-83c2-4b6c-a13c-8b9d36b2529b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65de81b6c1fa41d39f69b79ce861c68a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:53.054405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-339834b1-8f1d-4d9a-ab7e-0be3c33be86d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:53.059743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-339834b1-8f1d-4d9a-ab7e-0be3c33be86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:53.083174 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 861/1742] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:52 2022] DELETE /identity/v3/users/65de81b6c1fa41d39f69b79ce861c68a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:53.084707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5990-d48a-43fa-b6ef-4d2f42199341 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:53.086548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5990-d48a-43fa-b6ef-4d2f42199341 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.086990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5990-d48a-43fa-b6ef-4d2f42199341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.139255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-715b5990-d48a-43fa-b6ef-4d2f42199341 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:53.140419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-715b5990-d48a-43fa-b6ef-4d2f42199341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:53.189949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 882/1743] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:53.191584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339834b1-8f1d-4d9a-ab7e-0be3c33be86d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:53.193199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-339834b1-8f1d-4d9a-ab7e-0be3c33be86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:53.206923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339834b1-8f1d-4d9a-ab7e-0be3c33be86d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:53.317022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:53.317022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:53.317022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.317022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.317480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:53.317480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:53.317628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 862/1744] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:53.318924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b034a-8993-42da-ac67-0570dcc3d517 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:53.328959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b034a-8993-42da-ac67-0570dcc3d517 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.330477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b034a-8993-42da-ac67-0570dcc3d517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.350168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 883/1745] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:53.351146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:53.353356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:53.377914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-533b034a-8993-42da-ac67-0570dcc3d517 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:53.380951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-533b034a-8993-42da-ac67-0570dcc3d517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:53.393996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 863/1746] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:53.394399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b034a-8993-42da-ac67-0570dcc3d517 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:53.396112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-533b034a-8993-42da-ac67-0570dcc3d517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:53.432703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:53.488215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:53.513494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3b6fa-3d0b-4de0-bfee-b61c85e60221 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:53.516212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b034a-8993-42da-ac67-0570dcc3d517 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:53.529626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bf07d-9181-4c93-8677-6fe6c8a04790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:53.530447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf07d-9181-4c93-8677-6fe6c8a04790 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:53.530873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf07d-9181-4c93-8677-6fe6c8a04790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.531303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bf07d-9181-4c93-8677-6fe6c8a04790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.538991 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64678b8-0ed6-4392-a8e1-231cc2ec7bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:53.540203 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64678b8-0ed6-4392-a8e1-231cc2ec7bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:53.540589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64678b8-0ed6-4392-a8e1-231cc2ec7bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.540999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64678b8-0ed6-4392-a8e1-231cc2ec7bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.554334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bf07d-9181-4c93-8677-6fe6c8a04790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:53.558362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bf07d-9181-4c93-8677-6fe6c8a04790 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:53.589441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64678b8-0ed6-4392-a8e1-231cc2ec7bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:53.592587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64678b8-0ed6-4392-a8e1-231cc2ec7bd3 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:53.598696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 884/1747] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:53.601252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bf07d-9181-4c93-8677-6fe6c8a04790 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:53.628580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 864/1748] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:53.631853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64678b8-0ed6-4392-a8e1-231cc2ec7bd3 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:53.643210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bf07d-9181-4c93-8677-6fe6c8a04790 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:53.658168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e12eb-eb7e-4fc3-8e43-30fc958e0e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:53.660657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e12eb-eb7e-4fc3-8e43-30fc958e0e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:53.661601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64678b8-0ed6-4392-a8e1-231cc2ec7bd3 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:53.662153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e12eb-eb7e-4fc3-8e43-30fc958e0e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.663117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e12eb-eb7e-4fc3-8e43-30fc958e0e1d admin admin] PATH_INFO: `/v3/projects/d0f419105f9348498d44b3ce4b0a573c/users/d78a44ea4eda4199b4d96f89f0deb918/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.669746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e12eb-eb7e-4fc3-8e43-30fc958e0e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f419105f9348498d44b3ce4b0a573c, user_id=d78a44ea4eda4199b4d96f89f0deb918, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:53.678134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:53.679121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e12eb-eb7e-4fc3-8e43-30fc958e0e1d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:53.679883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:53.681131 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.681510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.720315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:53.722337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 885/1749] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:53 2022] PUT /identity/v3/projects/d0f419105f9348498d44b3ce4b0a573c/users/d78a44ea4eda4199b4d96f89f0deb918/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:53.724305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:53.733324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea71c7-8ee6-4b0a-8f70-f1f912c8f775 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:53.734076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea71c7-8ee6-4b0a-8f70-f1f912c8f775 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:53.734500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea71c7-8ee6-4b0a-8f70-f1f912c8f775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:53.781292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 865/1750] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:53.864182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1dea71c7-8ee6-4b0a-8f70-f1f912c8f775 None None] MFA Rules not processed for user `d78a44ea4eda4199b4d96f89f0deb918`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:53.865607 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1dea71c7-8ee6-4b0a-8f70-f1f912c8f775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:54.069810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 886/1751] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:54.083872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:54.086530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:54.301964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee2333-3360-488a-a4f9-637452527488 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:54.481927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f21ed-e79d-430d-866a-8241cf51e81a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:54.482951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f21ed-e79d-430d-866a-8241cf51e81a service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:54.483427 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f21ed-e79d-430d-866a-8241cf51e81a service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:54.483892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f21ed-e79d-430d-866a-8241cf51e81a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:54.501927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f21ed-e79d-430d-866a-8241cf51e81a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:54.510067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f21ed-e79d-430d-866a-8241cf51e81a service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:54.558323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 866/1752] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:54.629612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea71c7-8ee6-4b0a-8f70-f1f912c8f775 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:54.767232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea71c7-8ee6-4b0a-8f70-f1f912c8f775 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:54.786017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:54.786687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:54.790786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:54.790786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] PATH_INFO: `/v3/users/3b1c262c80c54351aa7156b180477087` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:54.790786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1c262c80c54351aa7156b180477087)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:54.790786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:54.868864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0a36-6d93-477b-834d-7a176f80f2fd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:54.869768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0a36-6d93-477b-834d-7a176f80f2fd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:54.870220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0a36-6d93-477b-834d-7a176f80f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:54.945385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:54.955809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1c262c80c54351aa7156b180477087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:54.985397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1c262c80c54351aa7156b180477087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:54.986500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1c262c80c54351aa7156b180477087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:55.013350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1c262c80c54351aa7156b180477087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:55.015910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e36d89f7-47fe-4178-a62d-02e1802eb7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1c262c80c54351aa7156b180477087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:55.020114 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5d6e0a36-6d93-477b-834d-7a176f80f2fd None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:55.024364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5d6e0a36-6d93-477b-834d-7a176f80f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:55.052762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 887/1753] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:54 2022] DELETE /identity/v3/users/3b1c262c80c54351aa7156b180477087 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:55.057287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c2eef-48e4-4f3c-ac8e-81fd5a0e6fb3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:55.059539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c2eef-48e4-4f3c-ac8e-81fd5a0e6fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:55.060865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c2eef-48e4-4f3c-ac8e-81fd5a0e6fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:55.140059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-199c2eef-48e4-4f3c-ac8e-81fd5a0e6fb3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:55.141685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-199c2eef-48e4-4f3c-ac8e-81fd5a0e6fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:55.227899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:55.246687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 867/1754] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 11:59:55.363580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 888/1755] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:55.420536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e0a36-6d93-477b-834d-7a176f80f2fd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:55.421996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5d6e0a36-6d93-477b-834d-7a176f80f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:55.519927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c2eef-48e4-4f3c-ac8e-81fd5a0e6fb3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:55.521789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-199c2eef-48e4-4f3c-ac8e-81fd5a0e6fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:55.569961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e0a36-6d93-477b-834d-7a176f80f2fd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:55.668365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:55.669462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:55.670062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:55.670494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:55.695045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:55.700350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:55.751471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 868/1756] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:55.757134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:55.760777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:55.813163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e835d0b-95e2-4e39-aab2-c1e9ff19f7b4 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:55.831974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:55.833089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c2eef-48e4-4f3c-ac8e-81fd5a0e6fb3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:55.833526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:55.833665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:55.839009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] PATH_INFO: `/v3/projects/62ec5830b9f442e0994ea5bdde4c3549` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:55.845407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ec5830b9f442e0994ea5bdde4c3549)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:55.849693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeaca3-df55-4975-adb9-a6effc005222 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:55.854415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaca3-df55-4975-adb9-a6effc005222 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:55.855317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:55.855439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaca3-df55-4975-adb9-a6effc005222 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:55.855787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaca3-df55-4975-adb9-a6effc005222 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:55.968729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ec5830b9f442e0994ea5bdde4c3549', 'request_id': 'req-16a4a430-c2a3-413b-a678-96d964dbefb1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:55.976541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:55.980824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ec5830b9f442e0994ea5bdde4c3549', 'request_id': 'req-16a4a430-c2a3-413b-a678-96d964dbefb1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:55.997956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ec5830b9f442e0994ea5bdde4c3549', 'request_id': 'req-16a4a430-c2a3-413b-a678-96d964dbefb1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:56.020568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] The token cache is being invalidate because project 62ec5830b9f442e0994ea5bdde4c3549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:56.020835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:56.021534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:56.022617 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeaca3-df55-4975-adb9-a6effc005222 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:56.025200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 869/1757] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:55 2022] DELETE /identity/v3/projects/62ec5830b9f442e0994ea5bdde4c3549 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:56.026006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:56.027126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeaca3-df55-4975-adb9-a6effc005222 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:56.029378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:56.073570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 889/1758] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 11:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 11:59:56.075226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667450ad-d434-4828-89ef-25d73fd5eb40 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:56.075519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667450ad-d434-4828-89ef-25d73fd5eb40 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:56.075792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667450ad-d434-4828-89ef-25d73fd5eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:56.156617 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-667450ad-d434-4828-89ef-25d73fd5eb40 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:56.158454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-667450ad-d434-4828-89ef-25d73fd5eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:56.181705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:56.230257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4a430-c2a3-413b-a678-96d964dbefb1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:56.254384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:56.255176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:56.255474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:56.255755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] PATH_INFO: `/v3/projects/07f2a3bcbe4c477b91598c8bcbe7e691` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:56.257880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f2a3bcbe4c477b91598c8bcbe7e691)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:56.260093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:56.297456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 890/1759] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:56.304760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c142e-a2a1-486e-ae81-d79ea14f902e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:56.305170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c142e-a2a1-486e-ae81-d79ea14f902e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:56.305518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c142e-a2a1-486e-ae81-d79ea14f902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:56.360327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-886c142e-a2a1-486e-ae81-d79ea14f902e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:56.363116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-886c142e-a2a1-486e-ae81-d79ea14f902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:56.385417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 891/1760] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:56.389514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c142e-a2a1-486e-ae81-d79ea14f902e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:56.410813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c142e-a2a1-486e-ae81-d79ea14f902e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:56.425700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f2a3bcbe4c477b91598c8bcbe7e691', 'request_id': 'req-5cb494e9-8a64-4f20-97ec-9bed39ec6941'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:56.446740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f2a3bcbe4c477b91598c8bcbe7e691', 'request_id': 'req-5cb494e9-8a64-4f20-97ec-9bed39ec6941'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:56.473240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f2a3bcbe4c477b91598c8bcbe7e691', 'request_id': 'req-5cb494e9-8a64-4f20-97ec-9bed39ec6941'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:56.502630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] The token cache is being invalidate because project 07f2a3bcbe4c477b91598c8bcbe7e691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:56.505509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:56.509744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:56.516993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 870/1761] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:56 2022] DELETE /identity/v3/projects/07f2a3bcbe4c477b91598c8bcbe7e691 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:56.540513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:56.550129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:56.637459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6a1c-be7e-4663-abf5-d2719f3923b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:56.638450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6a1c-be7e-4663-abf5-d2719f3923b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:56.638923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6a1c-be7e-4663-abf5-d2719f3923b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:56.639867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6a1c-be7e-4663-abf5-d2719f3923b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:56.641337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6a1c-be7e-4663-abf5-d2719f3923b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 11:59:56.642156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6a1c-be7e-4663-abf5-d2719f3923b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:56.645354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6a1c-be7e-4663-abf5-d2719f3923b9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:56.707244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 892/1762] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 11:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 11:59:56.712626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096dd6a-5b1c-4fb0-8381-1b0c1102534e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:56.713885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096dd6a-5b1c-4fb0-8381-1b0c1102534e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:56.714408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096dd6a-5b1c-4fb0-8381-1b0c1102534e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:56.801972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5096dd6a-5b1c-4fb0-8381-1b0c1102534e None None] MFA Rules not processed for user `912b5f1275fb43dfb1c0a9c47ecb3fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:56.804826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5096dd6a-5b1c-4fb0-8381-1b0c1102534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:56.891388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb494e9-8a64-4f20-97ec-9bed39ec6941 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:56.912208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:56.913141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:56.913599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:56.914026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] PATH_INFO: `/v3/users/719e8df7a9934c4bb0c0c8ef217300c6` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:56.925418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] RBAC: Authorizing `identity:delete_user(user_id=719e8df7a9934c4bb0c0c8ef217300c6)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:56.931201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:57.009762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 893/1763] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:57.010467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096dd6a-5b1c-4fb0-8381-1b0c1102534e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:57.016137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5096dd6a-5b1c-4fb0-8381-1b0c1102534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:57.055674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096dd6a-5b1c-4fb0-8381-1b0c1102534e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:57.070925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:57.071559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.071841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.072109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.078957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:57.083975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:57.156776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719e8df7a9934c4bb0c0c8ef217300c6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.173034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:57.233584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 894/1764] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:57 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:57.234036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:57.237325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719e8df7a9934c4bb0c0c8ef217300c6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.241198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719e8df7a9934c4bb0c0c8ef217300c6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.244202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:57.267402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719e8df7a9934c4bb0c0c8ef217300c6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.268440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719e8df7a9934c4bb0c0c8ef217300c6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.274707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:57.323242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 871/1765] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:56 2022] DELETE /identity/v3/users/719e8df7a9934c4bb0c0c8ef217300c6 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:57.325806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:57.328783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:57.513995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd2738-5a58-4879-a62c-8a488e0f434a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:57.575469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b7d80-337d-4c7e-bf52-62a7069f483b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:57.589745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15f2e2-f2ae-42b6-a8b0-7693acef18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:57.593853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15f2e2-f2ae-42b6-a8b0-7693acef18ef admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.594213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15f2e2-f2ae-42b6-a8b0-7693acef18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.594494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15f2e2-f2ae-42b6-a8b0-7693acef18ef admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.595177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15f2e2-f2ae-42b6-a8b0-7693acef18ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:57.603426 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15f2e2-f2ae-42b6-a8b0-7693acef18ef admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:57.650032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 872/1766] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:57 2022] POST /identity/v3/users => generated 303 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:57.656399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15f2e2-f2ae-42b6-a8b0-7693acef18ef admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:57.668777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15f2e2-f2ae-42b6-a8b0-7693acef18ef admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:57.674023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:57.674912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ba17c-ba9b-4997-ba03-6cdf53e0fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:57.676274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba17c-ba9b-4997-ba03-6cdf53e0fba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.676399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.677120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.677256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba17c-ba9b-4997-ba03-6cdf53e0fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.677353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] PATH_INFO: `/v3/users/ab07c60fcf6f42eaaadad92ebb30dffb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.677444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ba17c-ba9b-4997-ba03-6cdf53e0fba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.678173 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ba17c-ba9b-4997-ba03-6cdf53e0fba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:57.680020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ba17c-ba9b-4997-ba03-6cdf53e0fba7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:57.681031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab07c60fcf6f42eaaadad92ebb30dffb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:57.687522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:57.696771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 873/1767] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:57.701486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ba17c-ba9b-4997-ba03-6cdf53e0fba7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:57.730771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ba17c-ba9b-4997-ba03-6cdf53e0fba7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:57.742697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b33c5-7232-40b6-a99c-08c29c04b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:57.743414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b33c5-7232-40b6-a99c-08c29c04b014 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.743766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b33c5-7232-40b6-a99c-08c29c04b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.744112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b33c5-7232-40b6-a99c-08c29c04b014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.744853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b33c5-7232-40b6-a99c-08c29c04b014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:57.746596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b33c5-7232-40b6-a99c-08c29c04b014 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:57.766105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 874/1768] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 11:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 11:59:57.771273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b33c5-7232-40b6-a99c-08c29c04b014 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:57.798398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab07c60fcf6f42eaaadad92ebb30dffb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.801960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b33c5-7232-40b6-a99c-08c29c04b014 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:57.817111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cff998-f4b0-4c0d-b612-0a0aec548011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:57.817810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff998-f4b0-4c0d-b612-0a0aec548011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.818745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff998-f4b0-4c0d-b612-0a0aec548011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.819004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff998-f4b0-4c0d-b612-0a0aec548011 admin admin] PATH_INFO: `/v3/projects/189373ac64094cc89e4117c9650eb45e/users/3b70140b4e2d463d855be985ecc7fddb/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.836927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab07c60fcf6f42eaaadad92ebb30dffb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.839323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab07c60fcf6f42eaaadad92ebb30dffb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.857423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab07c60fcf6f42eaaadad92ebb30dffb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.858640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-478566d1-0387-48a5-b512-a2b2dab3ba53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab07c60fcf6f42eaaadad92ebb30dffb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:57.869375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cff998-f4b0-4c0d-b612-0a0aec548011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189373ac64094cc89e4117c9650eb45e, user_id=3b70140b4e2d463d855be985ecc7fddb, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:57.880502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cff998-f4b0-4c0d-b612-0a0aec548011 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:57.901293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 895/1769] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:57 2022] DELETE /identity/v3/users/ab07c60fcf6f42eaaadad92ebb30dffb => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:57.913216 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9322a-3df3-4358-b111-619f44269acf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.913580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9322a-3df3-4358-b111-619f44269acf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.913956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9322a-3df3-4358-b111-619f44269acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.921414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 875/1770] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 11:59:57 2022] PUT /identity/v3/projects/189373ac64094cc89e4117c9650eb45e/users/3b70140b4e2d463d855be985ecc7fddb/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:57.938789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dfe52-0f65-45ef-86bc-4a0f93eff804 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:57.938789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dfe52-0f65-45ef-86bc-4a0f93eff804 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:57.939074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dfe52-0f65-45ef-86bc-4a0f93eff804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:57.973438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d5a9322a-3df3-4358-b111-619f44269acf None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:57.974839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5a9322a-3df3-4358-b111-619f44269acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.022427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:58.035377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-347dfe52-0f65-45ef-86bc-4a0f93eff804 None None] MFA Rules not processed for user `3b70140b4e2d463d855be985ecc7fddb`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:58.050102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-347dfe52-0f65-45ef-86bc-4a0f93eff804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.126817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 896/1771] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:58.127821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9322a-3df3-4358-b111-619f44269acf None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:58.131256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5a9322a-3df3-4358-b111-619f44269acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.156831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9322a-3df3-4358-b111-619f44269acf None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:58.171321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:58.171979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:58.172267 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:58.172624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] PATH_INFO: `/v3/projects/6e6aa59f8ba84bf0aa876a2f6dd1559c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:58.173976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6aa59f8ba84bf0aa876a2f6dd1559c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:58.175015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 10 11:59:58.175015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: warnings.warn(msg) Oct 10 11:59:58.175015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: Oct 10 11:59:58.176883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:58.259398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 876/1772] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:58.260607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dfe52-0f65-45ef-86bc-4a0f93eff804 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:58.262360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-347dfe52-0f65-45ef-86bc-4a0f93eff804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.322566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6aa59f8ba84bf0aa876a2f6dd1559c', 'request_id': 'req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:58.329921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6aa59f8ba84bf0aa876a2f6dd1559c', 'request_id': 'req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:58.330807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:58.366040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6aa59f8ba84bf0aa876a2f6dd1559c', 'request_id': 'req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:58.406528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] The token cache is being invalidate because project 6e6aa59f8ba84bf0aa876a2f6dd1559c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:58.407526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:58.409341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:58.413674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dfe52-0f65-45ef-86bc-4a0f93eff804 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:58.418653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 897/1773] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:58 2022] DELETE /identity/v3/projects/6e6aa59f8ba84bf0aa876a2f6dd1559c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:58.418653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:58.424248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.547937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:58.548583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:58.548867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:58.549169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:58.561722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.682922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0a94-7c6f-4c9a-b4ff-cb261cf01fd6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:58.695404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:58.696826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:58.697488 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:58.698018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:58.699744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:58.703995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:58.747917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:58.756109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:58.812794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 898/1774] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 11:59:58 2022] POST /identity/v3/projects => generated 405 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:58.814598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:58.818562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 877/1775] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 11:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 11:59:58.819496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:58.819616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.820902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:58.845388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ff94-4189-41a7-b263-30ff30e3bc14 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:58.920694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:58.976741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:58.977578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:58.977866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:58.978140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] PATH_INFO: `/v3/projects/4e21855a8476471e94299230f1e87d55` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:58.980808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e21855a8476471e94299230f1e87d55)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:58.986177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:59.038533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c53d-cccb-4550-81bf-4d1b02e637ec admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:59.059773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:59.060622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:59.062163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:59.063995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] PATH_INFO: `/v3/users/fc78ff1011f344e5b3015b300dfc1d00` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:59.068809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc78ff1011f344e5b3015b300dfc1d00)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:59.075254 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:59.091201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 11:59:59.174549 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e21855a8476471e94299230f1e87d55', 'request_id': 'req-e8645477-48b3-46ed-aaef-02a9492d3ceb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.192414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc78ff1011f344e5b3015b300dfc1d00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.193176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e21855a8476471e94299230f1e87d55', 'request_id': 'req-e8645477-48b3-46ed-aaef-02a9492d3ceb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.233037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e21855a8476471e94299230f1e87d55', 'request_id': 'req-e8645477-48b3-46ed-aaef-02a9492d3ceb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.247333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc78ff1011f344e5b3015b300dfc1d00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.249203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc78ff1011f344e5b3015b300dfc1d00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.290384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] The token cache is being invalidate because project 4e21855a8476471e94299230f1e87d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 11:59:59.290950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc78ff1011f344e5b3015b300dfc1d00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.291031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.291294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc78ff1011f344e5b3015b300dfc1d00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.293813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8645477-48b3-46ed-aaef-02a9492d3ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 11:59:59.300964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 878/1776] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:58 2022] DELETE /identity/v3/projects/4e21855a8476471e94299230f1e87d55 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:59.302686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74147e0-f37c-4234-b2f1-08e74af4bc9f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:59.302982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74147e0-f37c-4234-b2f1-08e74af4bc9f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:59.303415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74147e0-f37c-4234-b2f1-08e74af4bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:59.346633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 899/1777] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:58 2022] DELETE /identity/v3/users/fc78ff1011f344e5b3015b300dfc1d00 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 11:59:59.349324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:59.352851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:59.367999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a74147e0-f37c-4234-b2f1-08e74af4bc9f None None] MFA Rules not processed for user `3a1f548368994994a2966b7818e8b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 11:59:59.370838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a74147e0-f37c-4234-b2f1-08e74af4bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:59.532019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 879/1778] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Oct 10 11:59:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 11:59:59.533023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74147e0-f37c-4234-b2f1-08e74af4bc9f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:59.538376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a74147e0-f37c-4234-b2f1-08e74af4bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:59.608449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2da808-0d00-4256-8f86-01ac522a703b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:59.627644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:59.632004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:59.633268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:59.634448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:59.635600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:59.641972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:59.721510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 900/1779] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 11:59:59 2022] POST /identity/v3/users => generated 309 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 11:59:59.722101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 11:59:59.725750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 11:59:59.773304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047644ea-6c08-46c8-96bc-f76d8d4c509d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:59.785458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:59.786687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:59.787020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:59.787300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] PATH_INFO: `/v3/projects/9b7f2bc5ec714cbf924be4e77594597b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:59.788939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74147e0-f37c-4234-b2f1-08e74af4bc9f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 11:59:59.813329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7f2bc5ec714cbf924be4e77594597b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:59.813329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:59.832940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 11:59:59.839743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 11:59:59.840121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 11:59:59.840433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] PATH_INFO: `/v3/users/d78a44ea4eda4199b4d96f89f0deb918` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 11:59:59.846372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78a44ea4eda4199b4d96f89f0deb918)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 11:59:59.848366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 11:59:59.947260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:00.053764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7f2bc5ec714cbf924be4e77594597b', 'request_id': 'req-1155a258-1272-41e8-aad8-13c94d9d48a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.061297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78a44ea4eda4199b4d96f89f0deb918'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.089004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7f2bc5ec714cbf924be4e77594597b', 'request_id': 'req-1155a258-1272-41e8-aad8-13c94d9d48a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.119065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78a44ea4eda4199b4d96f89f0deb918'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.120384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78a44ea4eda4199b4d96f89f0deb918'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.121700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7f2bc5ec714cbf924be4e77594597b', 'request_id': 'req-1155a258-1272-41e8-aad8-13c94d9d48a8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.147382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] The token cache is being invalidate because project 9b7f2bc5ec714cbf924be4e77594597b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:00.147726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.148452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.152713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78a44ea4eda4199b4d96f89f0deb918'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.154772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 901/1780] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 11:59:59 2022] DELETE /identity/v3/projects/9b7f2bc5ec714cbf924be4e77594597b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:00.155314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78a44ea4eda4199b4d96f89f0deb918'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:00.155727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:00.157673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:00.160238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:00.193366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 880/1781] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 11:59:59 2022] DELETE /identity/v3/users/d78a44ea4eda4199b4d96f89f0deb918 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:00.194331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:00.195823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:00.288274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155a258-1272-41e8-aad8-13c94d9d48a8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:00.397022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930947be-4517-4944-b447-64c30cd7054a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:00.405317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:00.406209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:00.406568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:00.406860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:00.412261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:00.445058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:00.446543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:00.455836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f820ad-9edb-4a8d-99d8-93bd570b4592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:00.457271 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f820ad-9edb-4a8d-99d8-93bd570b4592 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:00.457817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f820ad-9edb-4a8d-99d8-93bd570b4592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:00.458278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f820ad-9edb-4a8d-99d8-93bd570b4592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:00.473660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f820ad-9edb-4a8d-99d8-93bd570b4592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:00.478628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f820ad-9edb-4a8d-99d8-93bd570b4592 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:00.481766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 881/1782] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:00.482667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:00.488496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:00.516701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 902/1783] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:00.518416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fb025-7a67-4d67-b606-e09708dfabf1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:00.518416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fb025-7a67-4d67-b606-e09708dfabf1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:00.524079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fb025-7a67-4d67-b606-e09708dfabf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:00.620336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d51fb025-7a67-4d67-b606-e09708dfabf1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:00.629698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d51fb025-7a67-4d67-b606-e09708dfabf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:00.704233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dec21-9308-43cd-8fd0-e13e5d9b0ef1 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:00.717224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19b4ff-d884-4376-8d1d-aaf0b4dad1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:00.719055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19b4ff-d884-4376-8d1d-aaf0b4dad1cd admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:00.720862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19b4ff-d884-4376-8d1d-aaf0b4dad1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:00.721909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19b4ff-d884-4376-8d1d-aaf0b4dad1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:00.722082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19b4ff-d884-4376-8d1d-aaf0b4dad1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:00.727336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19b4ff-d884-4376-8d1d-aaf0b4dad1cd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:00.760319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 882/1784] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:00.761949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19b4ff-d884-4376-8d1d-aaf0b4dad1cd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:00.792411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19b4ff-d884-4376-8d1d-aaf0b4dad1cd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:00.809012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b3e7-1e6e-4c0f-850c-e4b2ccf21d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:00.809012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b3e7-1e6e-4c0f-850c-e4b2ccf21d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:00.809012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b3e7-1e6e-4c0f-850c-e4b2ccf21d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:00.809012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b3e7-1e6e-4c0f-850c-e4b2ccf21d97 admin admin] PATH_INFO: `/v3/projects/549b119984f3411ebea8ae5126cec354/users/26d356ff2d5b4a01b8f39aed6dcc15a8/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:00.842763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 903/1785] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:00.844204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c785d-518b-4228-ba74-a50fa2ce24ee None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:00.844492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c785d-518b-4228-ba74-a50fa2ce24ee None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:00.844772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c785d-518b-4228-ba74-a50fa2ce24ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:00.911971 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e66c785d-518b-4228-ba74-a50fa2ce24ee None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:00.913592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5b3e7-1e6e-4c0f-850c-e4b2ccf21d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549b119984f3411ebea8ae5126cec354, user_id=26d356ff2d5b4a01b8f39aed6dcc15a8, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:00.915031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e66c785d-518b-4228-ba74-a50fa2ce24ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:00.925113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5b3e7-1e6e-4c0f-850c-e4b2ccf21d97 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:00.948432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 904/1786] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:00.952775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c785d-518b-4228-ba74-a50fa2ce24ee None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:00.972164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c785d-518b-4228-ba74-a50fa2ce24ee None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:00.977227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 883/1787] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:00 2022] PUT /identity/v3/projects/549b119984f3411ebea8ae5126cec354/users/26d356ff2d5b4a01b8f39aed6dcc15a8/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:00.980477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b3e7-1e6e-4c0f-850c-e4b2ccf21d97 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:00.996107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:01.115832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:01.116484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.116870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.117249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.117972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:01.118344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:01.125438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:01.159148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 905/1788] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:01.161348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:01.176093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48773b02-7c25-405d-8390-cba9966cfa2c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:01.195296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b3e7-1e6e-4c0f-850c-e4b2ccf21d97 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:01.197608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208a791-db8f-4d29-9954-c3565d973d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:01.198460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a791-db8f-4d29-9954-c3565d973d94 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.199465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a791-db8f-4d29-9954-c3565d973d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.199811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a791-db8f-4d29-9954-c3565d973d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.200532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208a791-db8f-4d29-9954-c3565d973d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:01.202631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208a791-db8f-4d29-9954-c3565d973d94 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:01.217304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bdc35-7243-4149-bac2-9da2c056703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:01.217946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bdc35-7243-4149-bac2-9da2c056703c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.218258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bdc35-7243-4149-bac2-9da2c056703c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.221270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bdc35-7243-4149-bac2-9da2c056703c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.222001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bdc35-7243-4149-bac2-9da2c056703c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:01.235211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bdc35-7243-4149-bac2-9da2c056703c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:01.255224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:01.276145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 906/1789] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:01 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:01.277156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208a791-db8f-4d29-9954-c3565d973d94 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:01.279502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 884/1790] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:01.280362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bdc35-7243-4149-bac2-9da2c056703c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:01.310373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bdc35-7243-4149-bac2-9da2c056703c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:01.388351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208a791-db8f-4d29-9954-c3565d973d94 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:01.394628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9c1f-7b47-4952-b90d-c33fc45050d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:01.395282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9c1f-7b47-4952-b90d-c33fc45050d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.395679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9c1f-7b47-4952-b90d-c33fc45050d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.396108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9c1f-7b47-4952-b90d-c33fc45050d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.396859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a9c1f-7b47-4952-b90d-c33fc45050d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:01.399002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a9c1f-7b47-4952-b90d-c33fc45050d2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:01.450400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 907/1791] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:01 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:01.451931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9c1f-7b47-4952-b90d-c33fc45050d2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:01.472922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9758c14-53ce-45a7-af23-aa758265b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:01.473617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758c14-53ce-45a7-af23-aa758265b368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.473902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758c14-53ce-45a7-af23-aa758265b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.474176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758c14-53ce-45a7-af23-aa758265b368 admin admin] PATH_INFO: `/v3/projects/549b119984f3411ebea8ae5126cec354/users/26d356ff2d5b4a01b8f39aed6dcc15a8/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.479195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9758c14-53ce-45a7-af23-aa758265b368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549b119984f3411ebea8ae5126cec354, user_id=26d356ff2d5b4a01b8f39aed6dcc15a8, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:01.486485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9758c14-53ce-45a7-af23-aa758265b368 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:01.488440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9c1f-7b47-4952-b90d-c33fc45050d2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:01.506131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8c25d-f2d9-472d-a464-9541edd99bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:01.510185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c25d-f2d9-472d-a464-9541edd99bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.510717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c25d-f2d9-472d-a464-9541edd99bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.511181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c25d-f2d9-472d-a464-9541edd99bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.512132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8c25d-f2d9-472d-a464-9541edd99bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:01.514081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8c25d-f2d9-472d-a464-9541edd99bb2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:01.535578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 885/1792] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:01 2022] PUT /identity/v3/projects/549b119984f3411ebea8ae5126cec354/users/26d356ff2d5b4a01b8f39aed6dcc15a8/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:01.541372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 908/1793] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:01.541519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d495f-3e2d-4f24-81b9-4cf72c4e1cf8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.542498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8c25d-f2d9-472d-a464-9541edd99bb2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:01.545683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d495f-3e2d-4f24-81b9-4cf72c4e1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.546019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d495f-3e2d-4f24-81b9-4cf72c4e1cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.566961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8c25d-f2d9-472d-a464-9541edd99bb2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:01.658790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-114d495f-3e2d-4f24-81b9-4cf72c4e1cf8 None None] MFA Rules not processed for user `26d356ff2d5b4a01b8f39aed6dcc15a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:01.660610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-114d495f-3e2d-4f24-81b9-4cf72c4e1cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:01.689674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd24594-210d-4452-a129-1ceedc97bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:01.691106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd24594-210d-4452-a129-1ceedc97bc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.692115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd24594-210d-4452-a129-1ceedc97bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.693260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd24594-210d-4452-a129-1ceedc97bc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.694104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd24594-210d-4452-a129-1ceedc97bc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:01.717041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd24594-210d-4452-a129-1ceedc97bc08 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:01.773151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:01.805052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 909/1794] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:01.805052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd24594-210d-4452-a129-1ceedc97bc08 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:01.839393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd24594-210d-4452-a129-1ceedc97bc08 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:01.853858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a5a4d-8072-496a-b910-3a0d3d966065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:01.855306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5a4d-8072-496a-b910-3a0d3d966065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.857817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5a4d-8072-496a-b910-3a0d3d966065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.859029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5a4d-8072-496a-b910-3a0d3d966065 admin admin] PATH_INFO: `/v3/projects/6d5f7697b7a64b43b3351cd341ed77c4/users/fd8cdd08073b4ce59351a2b3d9dbf6b7/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:01.899516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a5a4d-8072-496a-b910-3a0d3d966065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5f7697b7a64b43b3351cd341ed77c4, user_id=fd8cdd08073b4ce59351a2b3d9dbf6b7, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:01.904841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a5a4d-8072-496a-b910-3a0d3d966065 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:01.913208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 886/1795] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:01.923131 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d495f-3e2d-4f24-81b9-4cf72c4e1cf8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:01.925202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-114d495f-3e2d-4f24-81b9-4cf72c4e1cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:01.950401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 910/1796] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:01 2022] PUT /identity/v3/projects/6d5f7697b7a64b43b3351cd341ed77c4/users/fd8cdd08073b4ce59351a2b3d9dbf6b7/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:01.967270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d436-e104-457b-8056-d213fbb38692 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:01.970185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d436-e104-457b-8056-d213fbb38692 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:01.971180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d436-e104-457b-8056-d213fbb38692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:02.130565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0920d436-e104-457b-8056-d213fbb38692 None None] MFA Rules not processed for user `fd8cdd08073b4ce59351a2b3d9dbf6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:02.138159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0920d436-e104-457b-8056-d213fbb38692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:02.210900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d495f-3e2d-4f24-81b9-4cf72c4e1cf8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:02.317963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:02.376639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:02.377381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:02.379703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:02.379988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:02.452570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 911/1797] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:02.458119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920d436-e104-457b-8056-d213fbb38692 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:02.464324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0920d436-e104-457b-8056-d213fbb38692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:02.558631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:02.560818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:02.575804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920d436-e104-457b-8056-d213fbb38692 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:02.582615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 887/1798] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:01 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:02.584085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:02.584701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:02.585088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:02.585437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] PATH_INFO: `/v3/projects/389e31c223e34b8ab3116e352408c996` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:02.586732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] RBAC: Authorizing `identity:delete_project(project_id=389e31c223e34b8ab3116e352408c996)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:02.588698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:02.594299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:02.598913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:02.616394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840deb5-4428-4079-bf83-889cd1d67331 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:02.622138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:02.622794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:02.623077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:02.623351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] PATH_INFO: `/v3/projects/d0f419105f9348498d44b3ce4b0a573c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:02.625059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f419105f9348498d44b3ce4b0a573c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:02.627946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:02.731342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f419105f9348498d44b3ce4b0a573c', 'request_id': 'req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.740123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f419105f9348498d44b3ce4b0a573c', 'request_id': 'req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.756568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f419105f9348498d44b3ce4b0a573c', 'request_id': 'req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.760332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389e31c223e34b8ab3116e352408c996', 'request_id': 'req-15245b07-fae6-48ce-ba36-e40bf07c26da'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.784716 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389e31c223e34b8ab3116e352408c996', 'request_id': 'req-15245b07-fae6-48ce-ba36-e40bf07c26da'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.798690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] The token cache is being invalidate because project d0f419105f9348498d44b3ce4b0a573c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:02.799288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.799468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389e31c223e34b8ab3116e352408c996', 'request_id': 'req-15245b07-fae6-48ce-ba36-e40bf07c26da'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.801946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.829548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:02.854780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 888/1799] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:02 2022] DELETE /identity/v3/projects/d0f419105f9348498d44b3ce4b0a573c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:02.857477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] The token cache is being invalidate because project 389e31c223e34b8ab3116e352408c996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:02.858000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.858706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:02.862570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:02.863211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:02.865083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 912/1800] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:02 2022] DELETE /identity/v3/projects/389e31c223e34b8ab3116e352408c996 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:02.865867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:02.867217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:03.141276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e16c20-d2fd-4cdb-8fd9-a7f6b53cb82f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:03.163025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:03.163847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:03.164139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:03.164386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] PATH_INFO: `/v3/projects/a5ffbb6b6cc64ba49d22da5f71dc96fd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:03.165563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ffbb6b6cc64ba49d22da5f71dc96fd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:03.167624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:03.179770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15245b07-fae6-48ce-ba36-e40bf07c26da admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:03.196319 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976ad60-cc70-48a7-a2a5-95fcfdedca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:03.197488 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ad60-cc70-48a7-a2a5-95fcfdedca6d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:03.198427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ad60-cc70-48a7-a2a5-95fcfdedca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:03.199021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ad60-cc70-48a7-a2a5-95fcfdedca6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:03.200367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976ad60-cc70-48a7-a2a5-95fcfdedca6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:03.201919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:03.203406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976ad60-cc70-48a7-a2a5-95fcfdedca6d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:03.287058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ffbb6b6cc64ba49d22da5f71dc96fd', 'request_id': 'req-61ed8e54-5589-4ce5-abe3-713939ba9116'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.299634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 913/1801] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:02 2022] POST /identity/v3/projects => generated 367 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:03.301947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea641-a836-45f5-bd36-9eeb06b56de2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:03.302242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea641-a836-45f5-bd36-9eeb06b56de2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:03.302626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccea641-a836-45f5-bd36-9eeb06b56de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:03.302961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ffbb6b6cc64ba49d22da5f71dc96fd', 'request_id': 'req-61ed8e54-5589-4ce5-abe3-713939ba9116'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.315578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ffbb6b6cc64ba49d22da5f71dc96fd', 'request_id': 'req-61ed8e54-5589-4ce5-abe3-713939ba9116'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.327596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bccea641-a836-45f5-bd36-9eeb06b56de2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:03.329758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bccea641-a836-45f5-bd36-9eeb06b56de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:03.345974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] The token cache is being invalidate because project a5ffbb6b6cc64ba49d22da5f71dc96fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:03.346281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.348730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.359826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 889/1802] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:02 2022] DELETE /identity/v3/projects/a5ffbb6b6cc64ba49d22da5f71dc96fd => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:03.359826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:03.362161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:03.458649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 914/1803] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:03.460453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccea641-a836-45f5-bd36-9eeb06b56de2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:03.466036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bccea641-a836-45f5-bd36-9eeb06b56de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:03.484689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccea641-a836-45f5-bd36-9eeb06b56de2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:03.493286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:03.494674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:03.495293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:03.496049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] PATH_INFO: `/v3/users/3b70140b4e2d463d855be985ecc7fddb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:03.497751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b70140b4e2d463d855be985ecc7fddb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:03.500243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:03.543334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed8e54-5589-4ce5-abe3-713939ba9116 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:03.557029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:03.557622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:03.557901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:03.558166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] PATH_INFO: `/v3/users/34386b400d1d446c99e8b11084ba4c40` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:03.569569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34386b400d1d446c99e8b11084ba4c40)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:03.574135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:03.601354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b70140b4e2d463d855be985ecc7fddb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.632700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b70140b4e2d463d855be985ecc7fddb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.640491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b70140b4e2d463d855be985ecc7fddb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.695166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b70140b4e2d463d855be985ecc7fddb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.697543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34386b400d1d446c99e8b11084ba4c40'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.699505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-943e8f7b-174a-49f9-afd5-10d5517679ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b70140b4e2d463d855be985ecc7fddb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.721670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34386b400d1d446c99e8b11084ba4c40'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.722555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34386b400d1d446c99e8b11084ba4c40'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.732811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:03.735871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34386b400d1d446c99e8b11084ba4c40'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.736679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34386b400d1d446c99e8b11084ba4c40'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:03.772322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 890/1804] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:03 2022] DELETE /identity/v3/users/34386b400d1d446c99e8b11084ba4c40 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:03.773368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:03.777155 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 915/1805] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:03 2022] DELETE /identity/v3/users/3b70140b4e2d463d855be985ecc7fddb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:03.780492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:03.784293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99fab-4ac4-4aae-b585-cdd3debe38b8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:03.784665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99fab-4ac4-4aae-b585-cdd3debe38b8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:03.787578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99fab-4ac4-4aae-b585-cdd3debe38b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:03.826181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:03.874492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-34e99fab-4ac4-4aae-b585-cdd3debe38b8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:03.879918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-34e99fab-4ac4-4aae-b585-cdd3debe38b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:03.934804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431f98e-30b2-4ed5-8c83-08e98167ac03 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:03.953167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf65ba0-c30d-46c3-b892-ad70d1723c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:03.956993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65ba0-c30d-46c3-b892-ad70d1723c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:03.957170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65ba0-c30d-46c3-b892-ad70d1723c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:03.957354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65ba0-c30d-46c3-b892-ad70d1723c31 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:03.958045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf65ba0-c30d-46c3-b892-ad70d1723c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:03.960099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf65ba0-c30d-46c3-b892-ad70d1723c31 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:03.972120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 916/1806] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:03.972120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1909a-f6bf-456f-b9a8-7a33ec71bbf3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:03.972120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1909a-f6bf-456f-b9a8-7a33ec71bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:03.972120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1909a-f6bf-456f-b9a8-7a33ec71bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.020458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-11d1909a-f6bf-456f-b9a8-7a33ec71bbf3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:04.023944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11d1909a-f6bf-456f-b9a8-7a33ec71bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:04.026528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 891/1807] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:03 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:04.029026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45456-120f-44c0-90b3-a5efa8c2a519 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.030646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45456-120f-44c0-90b3-a5efa8c2a519 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.032752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45456-120f-44c0-90b3-a5efa8c2a519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.053153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 917/1808] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:04.054740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bc7ec-cd60-495f-b6b8-3398a37dde23 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.056721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bc7ec-cd60-495f-b6b8-3398a37dde23 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.057026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bc7ec-cd60-495f-b6b8-3398a37dde23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.083051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-87b45456-120f-44c0-90b3-a5efa8c2a519 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:04.088141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-87b45456-120f-44c0-90b3-a5efa8c2a519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:04.125042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 892/1809] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:04.126891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45456-120f-44c0-90b3-a5efa8c2a519 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.136238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-393bc7ec-cd60-495f-b6b8-3398a37dde23 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:04.139120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-393bc7ec-cd60-495f-b6b8-3398a37dde23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:04.160920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 918/1810] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:04.161749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45456-120f-44c0-90b3-a5efa8c2a519 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:04.161884 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bc7ec-cd60-495f-b6b8-3398a37dde23 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.168667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2dd77-e2b8-4089-b9bd-aa6b1aab1119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:04.169410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2dd77-e2b8-4089-b9bd-aa6b1aab1119 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.170145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2dd77-e2b8-4089-b9bd-aa6b1aab1119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.170249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2dd77-e2b8-4089-b9bd-aa6b1aab1119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.171328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2dd77-e2b8-4089-b9bd-aa6b1aab1119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:04.173145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2dd77-e2b8-4089-b9bd-aa6b1aab1119 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:04.183724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bc7ec-cd60-495f-b6b8-3398a37dde23 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:04.189585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 893/1811] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:04.190342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:04.190532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2dd77-e2b8-4089-b9bd-aa6b1aab1119 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.190912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.191333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.191675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.193285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:04.193285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:04.194865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:04.204455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2dd77-e2b8-4089-b9bd-aa6b1aab1119 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:04.210276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 919/1812] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:04.211208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.211341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:04.212378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.212850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.213295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.214031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:04.214409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:04.216450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:04.223887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120751d0-268d-4104-aea5-fed811e5764a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:04.230418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d47f8-0f08-49b5-9d86-50f8acd2bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:04.231168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d47f8-0f08-49b5-9d86-50f8acd2bfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.231520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d47f8-0f08-49b5-9d86-50f8acd2bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.231993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d47f8-0f08-49b5-9d86-50f8acd2bfa4 admin admin] PATH_INFO: `/v3/projects/0d58a57b68d64226b396cf93c0c19bef/users/6711254204924ed589d3569aa10c8343/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.235476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 894/1813] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:04.236720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.239313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:04.252598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d47f8-0f08-49b5-9d86-50f8acd2bfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d58a57b68d64226b396cf93c0c19bef, user_id=6711254204924ed589d3569aa10c8343, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:04.255609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d47f8-0f08-49b5-9d86-50f8acd2bfa4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:04.276094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 920/1814] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:04 2022] PUT /identity/v3/projects/0d58a57b68d64226b396cf93c0c19bef/users/6711254204924ed589d3569aa10c8343/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:04.278066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d47f8-0f08-49b5-9d86-50f8acd2bfa4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.371396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf52814-12e1-450a-8a4f-6bed108e294c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:04.428452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d47f8-0f08-49b5-9d86-50f8acd2bfa4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:04.435848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b1ae-f96e-4e0b-b3aa-b5b612976c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:04.438189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b1ae-f96e-4e0b-b3aa-b5b612976c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.439339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b1ae-f96e-4e0b-b3aa-b5b612976c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.439552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b1ae-f96e-4e0b-b3aa-b5b612976c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.441580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b1ae-f96e-4e0b-b3aa-b5b612976c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:04.445938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b1ae-f96e-4e0b-b3aa-b5b612976c29 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:04.487988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaedaf-0266-47cd-b6f1-795b09736be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:04.496550 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaedaf-0266-47cd-b6f1-795b09736be4 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.498227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaedaf-0266-47cd-b6f1-795b09736be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.498733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaedaf-0266-47cd-b6f1-795b09736be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.525187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 921/1815] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:04 2022] POST /identity/v3/projects => generated 379 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:04.525187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b1ae-f96e-4e0b-b3aa-b5b612976c29 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.562999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaedaf-0266-47cd-b6f1-795b09736be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:04.567152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaedaf-0266-47cd-b6f1-795b09736be4 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:04.618834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 895/1816] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:04.619752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaedaf-0266-47cd-b6f1-795b09736be4 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.621395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:04.657480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaedaf-0266-47cd-b6f1-795b09736be4 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:04.689786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b1ae-f96e-4e0b-b3aa-b5b612976c29 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:04.697900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271348a-b448-4faa-b581-326f12e49ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:04.699564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271348a-b448-4faa-b581-326f12e49ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.700141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271348a-b448-4faa-b581-326f12e49ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.700141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271348a-b448-4faa-b581-326f12e49ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.701203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271348a-b448-4faa-b581-326f12e49ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:04.706698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271348a-b448-4faa-b581-326f12e49ac2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:04.755276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:04.766747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 922/1817] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:04 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:04.768299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40d35-fcaa-401a-86b8-0f8053a0f03e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.768567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40d35-fcaa-401a-86b8-0f8053a0f03e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.771651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40d35-fcaa-401a-86b8-0f8053a0f03e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.778861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 923/1818] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:00:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:04.780683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a40d35-fcaa-401a-86b8-0f8053a0f03e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.835976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b5905-ee17-4e1a-81dd-9d51d5203148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:04.836643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5905-ee17-4e1a-81dd-9d51d5203148 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:04.836957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5905-ee17-4e1a-81dd-9d51d5203148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:04.837383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5905-ee17-4e1a-81dd-9d51d5203148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:04.838038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b5905-ee17-4e1a-81dd-9d51d5203148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:04.839646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b5905-ee17-4e1a-81dd-9d51d5203148 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:04.874107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 896/1819] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:04.876213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b5905-ee17-4e1a-81dd-9d51d5203148 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:04.903351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b5905-ee17-4e1a-81dd-9d51d5203148 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.001104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a40d35-fcaa-401a-86b8-0f8053a0f03e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.038565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4f461-506c-48f9-b3ad-402e9486f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.039204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4f461-506c-48f9-b3ad-402e9486f28d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.039505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4f461-506c-48f9-b3ad-402e9486f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.039782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4f461-506c-48f9-b3ad-402e9486f28d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.040462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4f461-506c-48f9-b3ad-402e9486f28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.074627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4f461-506c-48f9-b3ad-402e9486f28d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.122503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962c70e-f307-4cb6-9a82-289958d76f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.141502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962c70e-f307-4cb6-9a82-289958d76f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.143604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962c70e-f307-4cb6-9a82-289958d76f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.145349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962c70e-f307-4cb6-9a82-289958d76f03 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.147913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962c70e-f307-4cb6-9a82-289958d76f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.153391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962c70e-f307-4cb6-9a82-289958d76f03 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.174673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 924/1820] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:04 2022] POST /identity/v3/users => generated 290 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:05.179569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2790075-7f35-452f-b082-b852492ed637 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.182895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2790075-7f35-452f-b082-b852492ed637 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.183454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2790075-7f35-452f-b082-b852492ed637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.230052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 897/1821] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:04 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:05.231937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962c70e-f307-4cb6-9a82-289958d76f03 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.242818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b2790075-7f35-452f-b082-b852492ed637 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:05.247212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b2790075-7f35-452f-b082-b852492ed637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:05.265108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962c70e-f307-4cb6-9a82-289958d76f03 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.278096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069911-5707-4a0a-8303-709889d9a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.279725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069911-5707-4a0a-8303-709889d9a083 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.280887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069911-5707-4a0a-8303-709889d9a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.280887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb069911-5707-4a0a-8303-709889d9a083 admin admin] PATH_INFO: `/v3/projects/0d58a57b68d64226b396cf93c0c19bef/users/6711254204924ed589d3569aa10c8343/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.292417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb069911-5707-4a0a-8303-709889d9a083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d58a57b68d64226b396cf93c0c19bef, user_id=6711254204924ed589d3569aa10c8343, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.303483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb069911-5707-4a0a-8303-709889d9a083 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.330672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 898/1822] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:05 2022] PUT /identity/v3/projects/0d58a57b68d64226b396cf93c0c19bef/users/6711254204924ed589d3569aa10c8343/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:05.343553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069911-5707-4a0a-8303-709889d9a083 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.423306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 925/1823] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:05.424187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2790075-7f35-452f-b082-b852492ed637 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.443569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2790075-7f35-452f-b082-b852492ed637 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.473673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb069911-5707-4a0a-8303-709889d9a083 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.480656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4e666-8a03-4350-ba27-99cd27945829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.481573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e666-8a03-4350-ba27-99cd27945829 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.481992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e666-8a03-4350-ba27-99cd27945829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.482539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e666-8a03-4350-ba27-99cd27945829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.483360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4e666-8a03-4350-ba27-99cd27945829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.485108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4e666-8a03-4350-ba27-99cd27945829 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.496666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 899/1824] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:05.497881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db029-61d2-47b8-b04a-d3e44bb41416 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.498169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db029-61d2-47b8-b04a-d3e44bb41416 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.498444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09db029-61d2-47b8-b04a-d3e44bb41416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.504175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:05.548251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e09db029-61d2-47b8-b04a-d3e44bb41416 None None] MFA Rules not processed for user `6711254204924ed589d3569aa10c8343`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:05.549276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e09db029-61d2-47b8-b04a-d3e44bb41416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:05.561144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f816c5-936b-48ec-884f-e0970f2252b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.561780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f816c5-936b-48ec-884f-e0970f2252b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.562064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f816c5-936b-48ec-884f-e0970f2252b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.562346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f816c5-936b-48ec-884f-e0970f2252b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.563255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f816c5-936b-48ec-884f-e0970f2252b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.564863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f816c5-936b-48ec-884f-e0970f2252b6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.586326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 926/1825] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:05.587636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5f58-a1b9-4f96-ae22-8a19358d015c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.587926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5f58-a1b9-4f96-ae22-8a19358d015c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.588202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5f58-a1b9-4f96-ae22-8a19358d015c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.594175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 927/1826] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:00:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:05.601824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5f58-a1b9-4f96-ae22-8a19358d015c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.605134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-949e5f58-a1b9-4f96-ae22-8a19358d015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:05.605399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:05.710636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 900/1827] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:05.712212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09db029-61d2-47b8-b04a-d3e44bb41416 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.739730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09db029-61d2-47b8-b04a-d3e44bb41416 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.750727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f2b4-7ba6-4982-b776-3c419bb3681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.751472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f2b4-7ba6-4982-b776-3c419bb3681c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.751827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f2b4-7ba6-4982-b776-3c419bb3681c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.752177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1f2b4-7ba6-4982-b776-3c419bb3681c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.752929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1f2b4-7ba6-4982-b776-3c419bb3681c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.758421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1f2b4-7ba6-4982-b776-3c419bb3681c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.792990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 901/1828] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:05.792990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f2b4-7ba6-4982-b776-3c419bb3681c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.801615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5f58-a1b9-4f96-ae22-8a19358d015c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.818237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1f2b4-7ba6-4982-b776-3c419bb3681c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.824289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edf21f-6348-4462-b9b3-3342761f7794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.825033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edf21f-6348-4462-b9b3-3342761f7794 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.825255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edf21f-6348-4462-b9b3-3342761f7794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.825500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edf21f-6348-4462-b9b3-3342761f7794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.826152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edf21f-6348-4462-b9b3-3342761f7794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.826565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.827453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.827951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.828424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.828544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edf21f-6348-4462-b9b3-3342761f7794 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.843911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 902/1829] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:05.845175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b5e0-fca6-4edb-a446-2ab235bc2513 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.845466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b5e0-fca6-4edb-a446-2ab235bc2513 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.845742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b5e0-fca6-4edb-a446-2ab235bc2513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:05.871938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:05.873938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:05.884581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5365b5e0-fca6-4edb-a446-2ab235bc2513 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:05.902694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5365b5e0-fca6-4edb-a446-2ab235bc2513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:05.916683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 928/1830] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:05.920623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.926143 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:05.931529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 903/1831] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:05.932862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365b5e0-fca6-4edb-a446-2ab235bc2513 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:05.955993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365b5e0-fca6-4edb-a446-2ab235bc2513 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:05.970743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a10621-ac6f-4a5a-9443-8316242ec6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:05.971719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a10621-ac6f-4a5a-9443-8316242ec6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:05.971855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a10621-ac6f-4a5a-9443-8316242ec6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:05.972168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a10621-ac6f-4a5a-9443-8316242ec6ed admin admin] PATH_INFO: `/v3/projects/691c986fd3084556a8ed901ef155896e/users/a1776d87da5e42d9b2c01c70624f4303/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:06.012397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a10621-ac6f-4a5a-9443-8316242ec6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=691c986fd3084556a8ed901ef155896e, user_id=a1776d87da5e42d9b2c01c70624f4303, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:06.021250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a10621-ac6f-4a5a-9443-8316242ec6ed admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:06.049620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 904/1832] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:05 2022] PUT /identity/v3/projects/691c986fd3084556a8ed901ef155896e/users/a1776d87da5e42d9b2c01c70624f4303/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:06.052429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a10621-ac6f-4a5a-9443-8316242ec6ed admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:06.066843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e85093-7e74-467f-b120-3618fefe4be3 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:06.223044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:06.223693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:06.223977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:06.224251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:06.230690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a10621-ac6f-4a5a-9443-8316242ec6ed admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:06.256860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c6198-17e4-461a-88e9-38d768ecc3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:06.257577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c6198-17e4-461a-88e9-38d768ecc3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:06.257885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c6198-17e4-461a-88e9-38d768ecc3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:06.258144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c6198-17e4-461a-88e9-38d768ecc3c0 admin admin] PATH_INFO: `/v3/projects/7ff0ea17149e4d09a08f30ae64a9f81c/users/c153a8e070374fc088bd084705972162/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:06.295754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c6198-17e4-461a-88e9-38d768ecc3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff0ea17149e4d09a08f30ae64a9f81c, user_id=c153a8e070374fc088bd084705972162, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:06.299945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c6198-17e4-461a-88e9-38d768ecc3c0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:06.303933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:06.331627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 905/1833] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:06 2022] PUT /identity/v3/projects/7ff0ea17149e4d09a08f30ae64a9f81c/users/c153a8e070374fc088bd084705972162/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:06.332923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9dac-5669-42f8-8fe5-dafbee83a247 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:06.336541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9dac-5669-42f8-8fe5-dafbee83a247 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:06.336888 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9dac-5669-42f8-8fe5-dafbee83a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:06.391900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:06.393629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:06.412137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-267b9dac-5669-42f8-8fe5-dafbee83a247 None None] MFA Rules not processed for user `a1776d87da5e42d9b2c01c70624f4303`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:06.413661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-267b9dac-5669-42f8-8fe5-dafbee83a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:06.434977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 929/1834] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:06.436045 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:06.439473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:06.592409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:06.640988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 906/1835] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:06.640988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9dac-5669-42f8-8fe5-dafbee83a247 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:06.642521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-267b9dac-5669-42f8-8fe5-dafbee83a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:06.730986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0853-a90e-41be-b927-012de74b1320 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:06.777489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9dac-5669-42f8-8fe5-dafbee83a247 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:06.789491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:06.791487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:06.791914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:06.792298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] PATH_INFO: `/v3/projects/3287e8a56a1d4a80b373e27247684b81` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:06.795736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3287e8a56a1d4a80b373e27247684b81)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:06.800263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:06.902193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3287e8a56a1d4a80b373e27247684b81', 'request_id': 'req-72bb303b-ff85-4208-9c49-2f944d2351f6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:06.921948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29697b3-f2ca-42c3-9147-414cabc46941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:06.922885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3287e8a56a1d4a80b373e27247684b81', 'request_id': 'req-72bb303b-ff85-4208-9c49-2f944d2351f6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:06.930589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29697b3-f2ca-42c3-9147-414cabc46941 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:06.930869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29697b3-f2ca-42c3-9147-414cabc46941 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:06.936852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29697b3-f2ca-42c3-9147-414cabc46941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:06.940164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3287e8a56a1d4a80b373e27247684b81', 'request_id': 'req-72bb303b-ff85-4208-9c49-2f944d2351f6'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:06.963211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29697b3-f2ca-42c3-9147-414cabc46941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:06.978262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29697b3-f2ca-42c3-9147-414cabc46941 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:06.984577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] The token cache is being invalidate because project 3287e8a56a1d4a80b373e27247684b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:06.984880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:06.987042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-72bb303b-ff85-4208-9c49-2f944d2351f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:06.994164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 907/1836] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:06 2022] DELETE /identity/v3/projects/3287e8a56a1d4a80b373e27247684b81 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:06.999718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07fefb-baed-444f-ae40-594a19acbb26 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:07.000003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07fefb-baed-444f-ae40-594a19acbb26 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:07.000275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07fefb-baed-444f-ae40-594a19acbb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:07.053521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 930/1837] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:07.061191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29697b3-f2ca-42c3-9147-414cabc46941 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:07.115144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ce07fefb-baed-444f-ae40-594a19acbb26 None None] MFA Rules not processed for user `c153a8e070374fc088bd084705972162`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:07.116347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce07fefb-baed-444f-ae40-594a19acbb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:07.247238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:07.256764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29697b3-f2ca-42c3-9147-414cabc46941 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:07.335672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 908/1838] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:07.342576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07fefb-baed-444f-ae40-594a19acbb26 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:07.345841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce07fefb-baed-444f-ae40-594a19acbb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:07.374656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:07.375376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:07.377912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:07.379346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:07.379628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:07.385903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:07.542202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07fefb-baed-444f-ae40-594a19acbb26 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:07.561119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff54e2-18c2-4632-94a6-a1b395026a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:07.564291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff54e2-18c2-4632-94a6-a1b395026a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:07.564591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff54e2-18c2-4632-94a6-a1b395026a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:07.564861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff54e2-18c2-4632-94a6-a1b395026a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:07.566176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff54e2-18c2-4632-94a6-a1b395026a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:07.570362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff54e2-18c2-4632-94a6-a1b395026a61 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:07.588394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:07.594439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:07.625320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 931/1839] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:07.628531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:07.633413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:07.664455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 909/1840] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:07 2022] POST /identity/v3/projects => generated 377 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:07.665920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462636f-9a7f-4b50-a487-0e9117210ef6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:07.667214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462636f-9a7f-4b50-a487-0e9117210ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:07.671351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462636f-9a7f-4b50-a487-0e9117210ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:07.674888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8479679-a628-4393-9e11-07ba219af968 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:07.715985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2462636f-9a7f-4b50-a487-0e9117210ef6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:07.717455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2462636f-9a7f-4b50-a487-0e9117210ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:07.863895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 910/1841] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:07.864870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462636f-9a7f-4b50-a487-0e9117210ef6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:07.866348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2462636f-9a7f-4b50-a487-0e9117210ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:07.896162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462636f-9a7f-4b50-a487-0e9117210ef6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:07.908261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954fe8-cb34-4fdb-99ac-7ad24f580afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:07.908261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954fe8-cb34-4fdb-99ac-7ad24f580afe admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:07.908674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954fe8-cb34-4fdb-99ac-7ad24f580afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:07.909090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca954fe8-cb34-4fdb-99ac-7ad24f580afe admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:07.910044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:07.910576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954fe8-cb34-4fdb-99ac-7ad24f580afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:07.911524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:07.911810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:07.912843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca954fe8-cb34-4fdb-99ac-7ad24f580afe admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:07.913114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] PATH_INFO: `/v3/projects/189373ac64094cc89e4117c9650eb45e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:07.915302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189373ac64094cc89e4117c9650eb45e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:07.924248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:07.968948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 911/1842] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:07 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:07.971184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954fe8-cb34-4fdb-99ac-7ad24f580afe admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.068218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189373ac64094cc89e4117c9650eb45e', 'request_id': 'req-b3f29257-3566-48cd-92f1-dac7b4fc7957'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.084542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189373ac64094cc89e4117c9650eb45e', 'request_id': 'req-b3f29257-3566-48cd-92f1-dac7b4fc7957'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.086285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.104960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189373ac64094cc89e4117c9650eb45e', 'request_id': 'req-b3f29257-3566-48cd-92f1-dac7b4fc7957'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.139562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] The token cache is being invalidate because project 189373ac64094cc89e4117c9650eb45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:08.139856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.143195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b3f29257-3566-48cd-92f1-dac7b4fc7957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.152313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 932/1843] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:07 2022] DELETE /identity/v3/projects/189373ac64094cc89e4117c9650eb45e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:08.155844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7365a-c781-4d25-ba48-d12f8d05915b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.156118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7365a-c781-4d25-ba48-d12f8d05915b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.156396 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7365a-c781-4d25-ba48-d12f8d05915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.199314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca954fe8-cb34-4fdb-99ac-7ad24f580afe admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.239554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d1f7365a-c781-4d25-ba48-d12f8d05915b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:08.245513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.248627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d1f7365a-c781-4d25-ba48-d12f8d05915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.384260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.385044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.385596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.385988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.386750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.388787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.442718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 912/1844] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:07 2022] POST /identity/v3/users => generated 295 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:08.443899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.453919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.476451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a7bb9-4510-4fae-af40-288473415ef3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.486777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.487529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.487879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.488811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.489722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.491767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.531237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 913/1845] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:08 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:08.536564 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.541795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 933/1846] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:08.544527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.548308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7365a-c781-4d25-ba48-d12f8d05915b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.554680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d1f7365a-c781-4d25-ba48-d12f8d05915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.586825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e906e-43ee-4d8d-9aa4-ac8d05e54c7b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.593021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7365a-c781-4d25-ba48-d12f8d05915b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.616813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.618935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.619695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.620401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] PATH_INFO: `/v3/users/26d356ff2d5b4a01b8f39aed6dcc15a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.623925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f941c8-d17d-43eb-8ff8-c10de37c16be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.624757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d356ff2d5b4a01b8f39aed6dcc15a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.626681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f941c8-d17d-43eb-8ff8-c10de37c16be admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.629245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f941c8-d17d-43eb-8ff8-c10de37c16be admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.629644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f941c8-d17d-43eb-8ff8-c10de37c16be admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.631096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f941c8-d17d-43eb-8ff8-c10de37c16be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.631536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.637524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f941c8-d17d-43eb-8ff8-c10de37c16be admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.668432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 934/1847] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:08.669455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f941c8-d17d-43eb-8ff8-c10de37c16be admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.681992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f941c8-d17d-43eb-8ff8-c10de37c16be admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.688685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a14ec3-238d-4fbe-9a1a-86bb1a5a8110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.689897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14ec3-238d-4fbe-9a1a-86bb1a5a8110 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.689897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14ec3-238d-4fbe-9a1a-86bb1a5a8110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.690283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14ec3-238d-4fbe-9a1a-86bb1a5a8110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.691413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14ec3-238d-4fbe-9a1a-86bb1a5a8110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.693265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14ec3-238d-4fbe-9a1a-86bb1a5a8110 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.713561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 935/1848] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:08.714743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a14ec3-238d-4fbe-9a1a-86bb1a5a8110 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.721545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d356ff2d5b4a01b8f39aed6dcc15a8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.730414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a14ec3-238d-4fbe-9a1a-86bb1a5a8110 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.735406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d356ff2d5b4a01b8f39aed6dcc15a8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.736196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d356ff2d5b4a01b8f39aed6dcc15a8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.736562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.737428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.737792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.738743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.739656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:08.740025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.742033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.746693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d356ff2d5b4a01b8f39aed6dcc15a8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.747544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d356ff2d5b4a01b8f39aed6dcc15a8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:08.761018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 936/1849] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:08.762151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.766772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 914/1850] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:08 2022] DELETE /identity/v3/users/26d356ff2d5b4a01b8f39aed6dcc15a8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:08.767017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.767216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.768578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.780395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3acec-fe5e-4be5-b643-bde0b2288907 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.837724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918d955-32b2-4b21-aa29-b4c09d7946f0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.842584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.843376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.843775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.844157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] PATH_INFO: `/v3/projects/c095f7cc859849d3964d0399e8e9127f/users/076c38cdddeb4e8db8c6b553f020040c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.852520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab9877-4abc-4ea5-adc9-1b2749788fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.853245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9877-4abc-4ea5-adc9-1b2749788fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.854130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9877-4abc-4ea5-adc9-1b2749788fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.854274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.854509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab9877-4abc-4ea5-adc9-1b2749788fdf admin admin] PATH_INFO: `/v3/projects/aa20711e97e34858bd2b0efd795fc540/users/da7a7fc364504155994c85e1150f1f03/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.864410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c095f7cc859849d3964d0399e8e9127f, user_id=076c38cdddeb4e8db8c6b553f020040c, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.868208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.871669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab9877-4abc-4ea5-adc9-1b2749788fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa20711e97e34858bd2b0efd795fc540, user_id=da7a7fc364504155994c85e1150f1f03, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.875628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab9877-4abc-4ea5-adc9-1b2749788fdf admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.886617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 915/1851] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:08 2022] PUT /identity/v3/projects/c095f7cc859849d3964d0399e8e9127f/users/076c38cdddeb4e8db8c6b553f020040c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:08.887661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.890934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:08.892433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 937/1852] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:08 2022] PUT /identity/v3/projects/aa20711e97e34858bd2b0efd795fc540/users/da7a7fc364504155994c85e1150f1f03/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:08.893456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab9877-4abc-4ea5-adc9-1b2749788fdf admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:08.944414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:08.975722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab9877-4abc-4ea5-adc9-1b2749788fdf admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.982692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b9807-7310-4dbe-b731-6b75d87df57b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:08.983697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56de4a-b0a4-44fa-be26-18701ca738b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.984510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56de4a-b0a4-44fa-be26-18701ca738b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.984862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56de4a-b0a4-44fa-be26-18701ca738b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.985203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56de4a-b0a4-44fa-be26-18701ca738b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.985940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56de4a-b0a4-44fa-be26-18701ca738b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.987605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56de4a-b0a4-44fa-be26-18701ca738b5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.988416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5c28-276a-4283-a1dc-5cdbb858aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:08.989246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5c28-276a-4283-a1dc-5cdbb858aad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:08.989534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5c28-276a-4283-a1dc-5cdbb858aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:08.989809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5c28-276a-4283-a1dc-5cdbb858aad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:08.990888 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e5c28-276a-4283-a1dc-5cdbb858aad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:08.992812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e5c28-276a-4283-a1dc-5cdbb858aad6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:08.998564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 938/1853] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:09.000263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56de4a-b0a4-44fa-be26-18701ca738b5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.011228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56de4a-b0a4-44fa-be26-18701ca738b5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.018467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e48f3-7071-4124-ae14-33829975eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.019230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e48f3-7071-4124-ae14-33829975eb43 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.020208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e48f3-7071-4124-ae14-33829975eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.020545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e48f3-7071-4124-ae14-33829975eb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.021479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e48f3-7071-4124-ae14-33829975eb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.023432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e48f3-7071-4124-ae14-33829975eb43 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.032234 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 916/1854] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:08 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:09.033195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5c28-276a-4283-a1dc-5cdbb858aad6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.038372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 939/1855] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:09.038372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e48f3-7071-4124-ae14-33829975eb43 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.061036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e48f3-7071-4124-ae14-33829975eb43 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.118142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5c28-276a-4283-a1dc-5cdbb858aad6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.132436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fbbd-2d2f-43ea-815b-2db7dd0fd760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.133541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fbbd-2d2f-43ea-815b-2db7dd0fd760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.134642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fbbd-2d2f-43ea-815b-2db7dd0fd760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.135102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fbbd-2d2f-43ea-815b-2db7dd0fd760 admin admin] PATH_INFO: `/v3/projects/c095f7cc859849d3964d0399e8e9127f/users/076c38cdddeb4e8db8c6b553f020040c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.137486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2fbbd-2d2f-43ea-815b-2db7dd0fd760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c095f7cc859849d3964d0399e8e9127f, user_id=076c38cdddeb4e8db8c6b553f020040c, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.140393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2fbbd-2d2f-43ea-815b-2db7dd0fd760 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.158708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9e14f-5fe9-4aa8-b0aa-223854535326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.159344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e14f-5fe9-4aa8-b0aa-223854535326 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.159689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e14f-5fe9-4aa8-b0aa-223854535326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.160168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e14f-5fe9-4aa8-b0aa-223854535326 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.161370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9e14f-5fe9-4aa8-b0aa-223854535326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.163754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9e14f-5fe9-4aa8-b0aa-223854535326 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.182404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 917/1856] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:09 2022] PUT /identity/v3/projects/c095f7cc859849d3964d0399e8e9127f/users/076c38cdddeb4e8db8c6b553f020040c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:09.182404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fbbd-2d2f-43ea-815b-2db7dd0fd760 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.195448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 940/1857] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:09 2022] POST /identity/v3/users => generated 282 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:09.197312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb9691-fe8b-46a0-83dc-0fa35e1942da None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.197736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb9691-fe8b-46a0-83dc-0fa35e1942da None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.198155 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb9691-fe8b-46a0-83dc-0fa35e1942da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.239037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8dcb9691-fe8b-46a0-83dc-0fa35e1942da None None] MFA Rules not processed for user `076c38cdddeb4e8db8c6b553f020040c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:09.240289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8dcb9691-fe8b-46a0-83dc-0fa35e1942da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.289232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fbbd-2d2f-43ea-815b-2db7dd0fd760 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.296593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4e02-ab9d-4959-9ff5-e98492edc077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.297817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4e02-ab9d-4959-9ff5-e98492edc077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.298293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4e02-ab9d-4959-9ff5-e98492edc077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.299295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a4e02-ab9d-4959-9ff5-e98492edc077 admin admin] PATH_INFO: `/v3/projects/aa20711e97e34858bd2b0efd795fc540/users/da7a7fc364504155994c85e1150f1f03/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.302339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4e02-ab9d-4959-9ff5-e98492edc077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa20711e97e34858bd2b0efd795fc540, user_id=da7a7fc364504155994c85e1150f1f03, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.307557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a4e02-ab9d-4959-9ff5-e98492edc077 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.324648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:09.330374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 918/1858] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:09 2022] PUT /identity/v3/projects/aa20711e97e34858bd2b0efd795fc540/users/da7a7fc364504155994c85e1150f1f03/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:09.331227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4e02-ab9d-4959-9ff5-e98492edc077 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.358647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 941/1859] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:09.360220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadbde2-24d4-464b-9b8e-61b8ca040769 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.360517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadbde2-24d4-464b-9b8e-61b8ca040769 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.360787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadbde2-24d4-464b-9b8e-61b8ca040769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.398801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2eadbde2-24d4-464b-9b8e-61b8ca040769 None None] MFA Rules not processed for user `da7a7fc364504155994c85e1150f1f03`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:09.400146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2eadbde2-24d4-464b-9b8e-61b8ca040769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.420653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a4e02-ab9d-4959-9ff5-e98492edc077 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.427126 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.427906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.428307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.428714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.429478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.430040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:09.431552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.442250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 919/1860] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:09.442940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.445099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.487236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 942/1861] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:09.488097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadbde2-24d4-464b-9b8e-61b8ca040769 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.502126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadbde2-24d4-464b-9b8e-61b8ca040769 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.507465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.508082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.508360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.508634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.509362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.511080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.523583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b13d2-1957-485d-b028-6591b3a42bd9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.526313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 943/1862] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:09.527317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.529031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.529227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.529977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.530359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.530624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.546711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e00ca7-c055-4a68-a8a6-bc059291a006 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.551787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.552853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.553430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.553892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.556015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.635782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.636024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.637625 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.638637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.648776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 944/1863] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:09.649997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.661121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f3209-f3de-44b4-8fe9-29d75b9e11ac service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.663696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 920/1864] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:09.664663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.666158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e6721-ca31-4156-ad7b-8948dba641ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.666825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e6721-ca31-4156-ad7b-8948dba641ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.667105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e6721-ca31-4156-ad7b-8948dba641ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.667394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e6721-ca31-4156-ad7b-8948dba641ba admin admin] PATH_INFO: `/v3/projects/35768c5c593f44369d4b31c8a5f17eb0/users/378d76cdb31d4bafaed47ccc5e65dbde/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.668046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.686155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3921aa-11f5-4b50-a039-63f28e5fee2e service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:09.688359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e6721-ca31-4156-ad7b-8948dba641ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=35768c5c593f44369d4b31c8a5f17eb0, user_id=378d76cdb31d4bafaed47ccc5e65dbde, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.691927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e6721-ca31-4156-ad7b-8948dba641ba admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.692062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:09.692631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.692934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.693241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] PATH_INFO: `/v3/projects/549b119984f3411ebea8ae5126cec354` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.694672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549b119984f3411ebea8ae5126cec354)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:09.696626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:09.723406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 945/1865] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:09 2022] PUT /identity/v3/projects/35768c5c593f44369d4b31c8a5f17eb0/users/378d76cdb31d4bafaed47ccc5e65dbde/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:09.724456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d480f2-e0c2-4f91-b118-f9e0e57541af None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.724743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d480f2-e0c2-4f91-b118-f9e0e57541af None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.725032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d480f2-e0c2-4f91-b118-f9e0e57541af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.765282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:09.773687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c0d480f2-e0c2-4f91-b118-f9e0e57541af None None] MFA Rules not processed for user `378d76cdb31d4bafaed47ccc5e65dbde`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:09.774930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c0d480f2-e0c2-4f91-b118-f9e0e57541af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.776096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549b119984f3411ebea8ae5126cec354', 'request_id': 'req-d314a15c-24ab-46b3-a295-a9258f535878'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:09.798213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549b119984f3411ebea8ae5126cec354', 'request_id': 'req-d314a15c-24ab-46b3-a295-a9258f535878'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:09.823886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549b119984f3411ebea8ae5126cec354', 'request_id': 'req-d314a15c-24ab-46b3-a295-a9258f535878'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:09.843226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] The token cache is being invalidate because project 549b119984f3411ebea8ae5126cec354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:09.843754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:09.844946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d314a15c-24ab-46b3-a295-a9258f535878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:09.848160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 921/1866] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:09 2022] DELETE /identity/v3/projects/549b119984f3411ebea8ae5126cec354 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:09.857214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df926-2015-4523-8d39-8aaf723027c6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.857731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df926-2015-4523-8d39-8aaf723027c6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.858018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df926-2015-4523-8d39-8aaf723027c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.879684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-653df926-2015-4523-8d39-8aaf723027c6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:09.881008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-653df926-2015-4523-8d39-8aaf723027c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.887002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 946/1867] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:09.891550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d480f2-e0c2-4f91-b118-f9e0e57541af None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:09.893458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c0d480f2-e0c2-4f91-b118-f9e0e57541af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:09.910690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:09.962977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 922/1868] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:09.974712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d3b6-87c8-46c4-8462-7f5c5814ba6f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:09.975018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d3b6-87c8-46c4-8462-7f5c5814ba6f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:09.975266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d3b6-87c8-46c4-8462-7f5c5814ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:09.989650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d480f2-e0c2-4f91-b118-f9e0e57541af None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.000463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4956d09-0d14-48e5-b805-bab6740a727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.001212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956d09-0d14-48e5-b805-bab6740a727b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.003547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f2a5d3b6-87c8-46c4-8462-7f5c5814ba6f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:10.004958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956d09-0d14-48e5-b805-bab6740a727b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.005345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4956d09-0d14-48e5-b805-bab6740a727b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.005746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f2a5d3b6-87c8-46c4-8462-7f5c5814ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:10.009126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4956d09-0d14-48e5-b805-bab6740a727b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.015345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4956d09-0d14-48e5-b805-bab6740a727b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.015646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 923/1869] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:10.020106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d3b6-87c8-46c4-8462-7f5c5814ba6f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.041623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d3b6-87c8-46c4-8462-7f5c5814ba6f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.051401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.052231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.052574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.052799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.053569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:10.053866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.055623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.062501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 947/1870] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:09 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:10.063329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4956d09-0d14-48e5-b805-bab6740a727b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.072907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 924/1871] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:10.083233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.106744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bc28f-ea52-40be-a94b-a1a27e9b90b9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.179453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4956d09-0d14-48e5-b805-bab6740a727b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.189008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b793-4bee-48df-95a2-9726e9ec80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.189652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b793-4bee-48df-95a2-9726e9ec80bd admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.189936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b793-4bee-48df-95a2-9726e9ec80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.190360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88b793-4bee-48df-95a2-9726e9ec80bd admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.191080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88b793-4bee-48df-95a2-9726e9ec80bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.194112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88b793-4bee-48df-95a2-9726e9ec80bd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.225592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 948/1872] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:10 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:10.232379 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b793-4bee-48df-95a2-9726e9ec80bd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.255176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88b793-4bee-48df-95a2-9726e9ec80bd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.257600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490cb61-2754-43d9-95d0-3405f74fd7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.258293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490cb61-2754-43d9-95d0-3405f74fd7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.258753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490cb61-2754-43d9-95d0-3405f74fd7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.259036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490cb61-2754-43d9-95d0-3405f74fd7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.260723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490cb61-2754-43d9-95d0-3405f74fd7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.261279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.261973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.262349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.262696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.263457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.265352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490cb61-2754-43d9-95d0-3405f74fd7ca admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.270750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.284270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 949/1873] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:10.289326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.290999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:10.302177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 925/1874] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:10 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:10.303088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490cb61-2754-43d9-95d0-3405f74fd7ca admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.350524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:10.357348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de3745-c1e5-4e00-8745-e7bdf9345133 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.393672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:10.396363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490cb61-2754-43d9-95d0-3405f74fd7ca admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.402343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb89c-c3af-4a20-901b-4f055b760887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.403026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb89c-c3af-4a20-901b-4f055b760887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.403311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb89c-c3af-4a20-901b-4f055b760887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.403595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edb89c-c3af-4a20-901b-4f055b760887 admin admin] PATH_INFO: `/v3/projects/09553b8d36ed46839de7943a7843b0aa/users/8a13d76dd03f487993020f90af482f1c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.422350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edb89c-c3af-4a20-901b-4f055b760887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09553b8d36ed46839de7943a7843b0aa, user_id=8a13d76dd03f487993020f90af482f1c, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.425124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edb89c-c3af-4a20-901b-4f055b760887 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.428039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.429702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.430223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.430575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.432517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:10.439736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 926/1875] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:10 2022] PUT /identity/v3/projects/09553b8d36ed46839de7943a7843b0aa/users/8a13d76dd03f487993020f90af482f1c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:10.440855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb89c-c3af-4a20-901b-4f055b760887 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.496326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.497811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.507354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 950/1876] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:10.508117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.520551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e02ad-0116-49c0-b348-ada8becf11f2 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.521697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edb89c-c3af-4a20-901b-4f055b760887 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.530274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627093f-39aa-4baa-baca-b0f385c6b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.531718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4e3ed-86cc-420a-afd1-af2b9ab16e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.532277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627093f-39aa-4baa-baca-b0f385c6b91c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.533157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e3ed-86cc-420a-afd1-af2b9ab16e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.533585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627093f-39aa-4baa-baca-b0f385c6b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.533949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627093f-39aa-4baa-baca-b0f385c6b91c admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.534343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e3ed-86cc-420a-afd1-af2b9ab16e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.534998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4e3ed-86cc-420a-afd1-af2b9ab16e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.536048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627093f-39aa-4baa-baca-b0f385c6b91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.537728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4e3ed-86cc-420a-afd1-af2b9ab16e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.538358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627093f-39aa-4baa-baca-b0f385c6b91c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.539950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4e3ed-86cc-420a-afd1-af2b9ab16e47 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.552077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 951/1877] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:10.556900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4e3ed-86cc-420a-afd1-af2b9ab16e47 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.563309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 927/1878] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:10 2022] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:10.567395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627093f-39aa-4baa-baca-b0f385c6b91c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.567749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4e3ed-86cc-420a-afd1-af2b9ab16e47 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.572543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc859-8ac4-48e0-a171-394b0dd2fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.573244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc859-8ac4-48e0-a171-394b0dd2fd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.573522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc859-8ac4-48e0-a171-394b0dd2fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.573787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc859-8ac4-48e0-a171-394b0dd2fd08 admin admin] PATH_INFO: `/v3/projects/09553b8d36ed46839de7943a7843b0aa/users/8a13d76dd03f487993020f90af482f1c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.575719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdc859-8ac4-48e0-a171-394b0dd2fd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09553b8d36ed46839de7943a7843b0aa, user_id=8a13d76dd03f487993020f90af482f1c, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.578411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdc859-8ac4-48e0-a171-394b0dd2fd08 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.580850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627093f-39aa-4baa-baca-b0f385c6b91c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.587527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56c719-31ab-4db6-870b-dcb6bb7f7b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.588381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56c719-31ab-4db6-870b-dcb6bb7f7b3d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.588669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56c719-31ab-4db6-870b-dcb6bb7f7b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.589207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56c719-31ab-4db6-870b-dcb6bb7f7b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.589673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 952/1879] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:10 2022] PUT /identity/v3/projects/09553b8d36ed46839de7943a7843b0aa/users/8a13d76dd03f487993020f90af482f1c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:10.593389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56c719-31ab-4db6-870b-dcb6bb7f7b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.594977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56c719-31ab-4db6-870b-dcb6bb7f7b3d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.602141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6dc89-916a-462f-aebf-33739a6ef64b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.603077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6dc89-916a-462f-aebf-33739a6ef64b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.603356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6dc89-916a-462f-aebf-33739a6ef64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.608791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 928/1880] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:10.612556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56c719-31ab-4db6-870b-dcb6bb7f7b3d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.623984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56c719-31ab-4db6-870b-dcb6bb7f7b3d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.635498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2cd6dc89-916a-462f-aebf-33739a6ef64b None None] MFA Rules not processed for user `8a13d76dd03f487993020f90af482f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:10.636844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2cd6dc89-916a-462f-aebf-33739a6ef64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:10.700845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aa5f5-9915-40cb-8436-72d8a4226424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.701880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa5f5-9915-40cb-8436-72d8a4226424 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.702227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa5f5-9915-40cb-8436-72d8a4226424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.702789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa5f5-9915-40cb-8436-72d8a4226424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.703755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa5f5-9915-40cb-8436-72d8a4226424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.705545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa5f5-9915-40cb-8436-72d8a4226424 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.717511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 929/1881] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:10.721677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aa5f5-9915-40cb-8436-72d8a4226424 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.725210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 953/1882] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:10.736679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6dc89-916a-462f-aebf-33739a6ef64b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.737719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aa5f5-9915-40cb-8436-72d8a4226424 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.739246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2cd6dc89-916a-462f-aebf-33739a6ef64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:10.744879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c43e93-723d-4acc-a1e8-5083d1fc5d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.745647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43e93-723d-4acc-a1e8-5083d1fc5d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.746720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43e93-723d-4acc-a1e8-5083d1fc5d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.747597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c43e93-723d-4acc-a1e8-5083d1fc5d67 admin admin] PATH_INFO: `/v3/projects/743c5d07fe994ec092b0258405e529e9/users/4303d50b357d4266a48d173da05436c5/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.772770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c43e93-723d-4acc-a1e8-5083d1fc5d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743c5d07fe994ec092b0258405e529e9, user_id=4303d50b357d4266a48d173da05436c5, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.776336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c43e93-723d-4acc-a1e8-5083d1fc5d67 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:10.800258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 930/1883] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:10 2022] PUT /identity/v3/projects/743c5d07fe994ec092b0258405e529e9/users/4303d50b357d4266a48d173da05436c5/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:10.817078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334dab-c2ba-4108-b88b-2f2b10555ebb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.817181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334dab-c2ba-4108-b88b-2f2b10555ebb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.817484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334dab-c2ba-4108-b88b-2f2b10555ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.819230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6dc89-916a-462f-aebf-33739a6ef64b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:10.821490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:10.846119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:10.860492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8b334dab-c2ba-4108-b88b-2f2b10555ebb None None] MFA Rules not processed for user `4303d50b357d4266a48d173da05436c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:10.862372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8b334dab-c2ba-4108-b88b-2f2b10555ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:10.893440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fde39d-8bfd-464c-a4ab-4b38e2ec213c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:10.894212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fde39d-8bfd-464c-a4ab-4b38e2ec213c service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:10.894553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fde39d-8bfd-464c-a4ab-4b38e2ec213c service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:10.895337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fde39d-8bfd-464c-a4ab-4b38e2ec213c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:10.967173 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 931/1884] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:10.971330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334dab-c2ba-4108-b88b-2f2b10555ebb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:10.983394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fde39d-8bfd-464c-a4ab-4b38e2ec213c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:10.984883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fde39d-8bfd-464c-a4ab-4b38e2ec213c service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.001182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 954/1885] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:11.056163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334dab-c2ba-4108-b88b-2f2b10555ebb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.061375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3315-fc76-4e8d-b567-82067fcb7c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.061988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3315-fc76-4e8d-b567-82067fcb7c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.062267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3315-fc76-4e8d-b567-82067fcb7c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.062542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af3315-fc76-4e8d-b567-82067fcb7c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.063165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3315-fc76-4e8d-b567-82067fcb7c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.065074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af3315-fc76-4e8d-b567-82067fcb7c1b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.094602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fde39d-8bfd-464c-a4ab-4b38e2ec213c service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:11.097015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 932/1886] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:10 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:11.100051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3315-fc76-4e8d-b567-82067fcb7c1b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:11.104210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fde39d-8bfd-464c-a4ab-4b38e2ec213c service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.163429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c68c10-16b8-4110-8859-0e0b6c14668f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.164107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68c10-16b8-4110-8859-0e0b6c14668f service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.164437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68c10-16b8-4110-8859-0e0b6c14668f service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.164763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c68c10-16b8-4110-8859-0e0b6c14668f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.173911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af3315-fc76-4e8d-b567-82067fcb7c1b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.179323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2b463-b06a-4d29-97f2-99b771b54ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.179943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2b463-b06a-4d29-97f2-99b771b54ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.180224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2b463-b06a-4d29-97f2-99b771b54ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.180497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2b463-b06a-4d29-97f2-99b771b54ccd admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.181160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2b463-b06a-4d29-97f2-99b771b54ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.183190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2b463-b06a-4d29-97f2-99b771b54ccd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.209632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 933/1887] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:11 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:11.214136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2b463-b06a-4d29-97f2-99b771b54ccd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:11.224490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2b463-b06a-4d29-97f2-99b771b54ccd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.229641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b89fb-4c04-48b5-abe2-2fa6a6f705ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.230270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b89fb-4c04-48b5-abe2-2fa6a6f705ab admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.230552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b89fb-4c04-48b5-abe2-2fa6a6f705ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.230825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b89fb-4c04-48b5-abe2-2fa6a6f705ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.233313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b89fb-4c04-48b5-abe2-2fa6a6f705ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.234799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b89fb-4c04-48b5-abe2-2fa6a6f705ab admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.235351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c68c10-16b8-4110-8859-0e0b6c14668f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.237233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c68c10-16b8-4110-8859-0e0b6c14668f service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.247267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 934/1888] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:11.247932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 955/1889] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:11.265308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b89fb-4c04-48b5-abe2-2fa6a6f705ab admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:11.271523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:11.279982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b89fb-4c04-48b5-abe2-2fa6a6f705ab admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.295087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bef900-4edc-4069-ad0f-be78f2476144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.296138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bef900-4edc-4069-ad0f-be78f2476144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.296487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bef900-4edc-4069-ad0f-be78f2476144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.296947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bef900-4edc-4069-ad0f-be78f2476144 admin admin] PATH_INFO: `/v3/projects/fba2a485d51c4e09b7d087c82eec2aab/users/d23a299b6f1244b985cb2aef7ace0484/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.308370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c68c10-16b8-4110-8859-0e0b6c14668f service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:11.318591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c68c10-16b8-4110-8859-0e0b6c14668f service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.324250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.324881 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.325465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.325742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.328092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:11.337275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:11.337416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bef900-4edc-4069-ad0f-be78f2476144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba2a485d51c4e09b7d087c82eec2aab, user_id=d23a299b6f1244b985cb2aef7ace0484, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.340243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bef900-4edc-4069-ad0f-be78f2476144 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.382767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 935/1890] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:11 2022] PUT /identity/v3/projects/fba2a485d51c4e09b7d087c82eec2aab/users/d23a299b6f1244b985cb2aef7ace0484/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:11.383666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bef900-4edc-4069-ad0f-be78f2476144 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:11.464387 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.466221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.489734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 956/1891] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:11.531415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bef900-4edc-4069-ad0f-be78f2476144 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.538403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0db3d-384e-4ef8-8ddd-d8bd71558550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.539165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0db3d-384e-4ef8-8ddd-d8bd71558550 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.539529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0db3d-384e-4ef8-8ddd-d8bd71558550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.539876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0db3d-384e-4ef8-8ddd-d8bd71558550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.540596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0db3d-384e-4ef8-8ddd-d8bd71558550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.542734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0db3d-384e-4ef8-8ddd-d8bd71558550 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.554980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 936/1892] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:11.559485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:11.571019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc91cd-ae28-4ade-863b-93c2393aaff5 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.578109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510bd02-65b8-47a6-ad2e-ef73879d07ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.579172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bd02-65b8-47a6-ad2e-ef73879d07ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.579491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bd02-65b8-47a6-ad2e-ef73879d07ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.579727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510bd02-65b8-47a6-ad2e-ef73879d07ab admin admin] PATH_INFO: `/v3/projects/fba2a485d51c4e09b7d087c82eec2aab/users/d23a299b6f1244b985cb2aef7ace0484/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.581878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510bd02-65b8-47a6-ad2e-ef73879d07ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba2a485d51c4e09b7d087c82eec2aab, user_id=d23a299b6f1244b985cb2aef7ace0484, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.584583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510bd02-65b8-47a6-ad2e-ef73879d07ab admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.600207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 957/1893] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:11 2022] PUT /identity/v3/projects/fba2a485d51c4e09b7d087c82eec2aab/users/d23a299b6f1244b985cb2aef7ace0484/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:11.608376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722edebf-8e8a-4fad-802c-741e83225402 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.608638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722edebf-8e8a-4fad-802c-741e83225402 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.609124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722edebf-8e8a-4fad-802c-741e83225402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.646123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-722edebf-8e8a-4fad-802c-741e83225402 None None] MFA Rules not processed for user `d23a299b6f1244b985cb2aef7ace0484`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:11.647865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-722edebf-8e8a-4fad-802c-741e83225402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:11.750936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 937/1894] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:11.769660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510bd02-65b8-47a6-ad2e-ef73879d07ab admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:11.838997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510bd02-65b8-47a6-ad2e-ef73879d07ab admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:11.842759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36bc50-d051-41ae-b25e-419f07fa59cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:11.843435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc50-d051-41ae-b25e-419f07fa59cb service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:11.843721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc50-d051-41ae-b25e-419f07fa59cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:11.843996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc50-d051-41ae-b25e-419f07fa59cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:11.854341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36bc50-d051-41ae-b25e-419f07fa59cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:11.855925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36bc50-d051-41ae-b25e-419f07fa59cb service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:11.867617 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 958/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:12.790794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722edebf-8e8a-4fad-802c-741e83225402 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:12.963006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722edebf-8e8a-4fad-802c-741e83225402 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:12.994580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:12.995241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:12.995522 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:12.996528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] PATH_INFO: `/v3/users/4303d50b357d4266a48d173da05436c5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:12.998269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4303d50b357d4266a48d173da05436c5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:13.000365 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:13.004091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:13.123291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4303d50b357d4266a48d173da05436c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.152348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4303d50b357d4266a48d173da05436c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.157891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4303d50b357d4266a48d173da05436c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.168718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4303d50b357d4266a48d173da05436c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.170124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4303d50b357d4266a48d173da05436c5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.194003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 938/1896] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:12 2022] DELETE /identity/v3/users/4303d50b357d4266a48d173da05436c5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:13.195808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad664-f8fc-4406-ad50-7e5a1966e00b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:13.196291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad664-f8fc-4406-ad50-7e5a1966e00b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:13.196496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ad664-f8fc-4406-ad50-7e5a1966e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:13.256179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f75ad664-f8fc-4406-ad50-7e5a1966e00b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:13.257861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f75ad664-f8fc-4406-ad50-7e5a1966e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:13.356840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 959/1897] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:13.369519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:13.371903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:13.491199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d34bd-2ece-4302-a899-5fa51a518e84 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:13.495524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77be52e-f48a-4471-a253-48c2a3075b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:13.496451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77be52e-f48a-4471-a253-48c2a3075b3b service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:13.496963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77be52e-f48a-4471-a253-48c2a3075b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:13.497485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77be52e-f48a-4471-a253-48c2a3075b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:13.515634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ad664-f8fc-4406-ad50-7e5a1966e00b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:13.518401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77be52e-f48a-4471-a253-48c2a3075b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:13.521557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77be52e-f48a-4471-a253-48c2a3075b3b service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:13.522716 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f75ad664-f8fc-4406-ad50-7e5a1966e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:13.543598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 939/1898] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:13.567799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ad664-f8fc-4406-ad50-7e5a1966e00b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:13.600206 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:13.601645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:13.602201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:13.602651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] PATH_INFO: `/v3/users/c153a8e070374fc088bd084705972162` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:13.605917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c153a8e070374fc088bd084705972162)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:13.608120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:13.677450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:13.700647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c153a8e070374fc088bd084705972162'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.717125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c153a8e070374fc088bd084705972162'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.717878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c153a8e070374fc088bd084705972162'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.727175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c153a8e070374fc088bd084705972162'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.727846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c153a8e070374fc088bd084705972162'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:13.747253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 960/1899] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:13 2022] DELETE /identity/v3/users/c153a8e070374fc088bd084705972162 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:13.752295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5c69-989b-4670-b30d-61729d276662 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:13.752595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5c69-989b-4670-b30d-61729d276662 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:13.753378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5c69-989b-4670-b30d-61729d276662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:13.776519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c06d5c69-989b-4670-b30d-61729d276662 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:13.777799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c06d5c69-989b-4670-b30d-61729d276662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:13.868061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 940/1900] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:13.871042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:13.872613 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:13.966149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beeee14-5c6e-4225-a538-8fe488cb6768 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:13.969941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654bcb2-2072-4154-812d-4e3c91be4864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:13.970556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654bcb2-2072-4154-812d-4e3c91be4864 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:13.970839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654bcb2-2072-4154-812d-4e3c91be4864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:13.971116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654bcb2-2072-4154-812d-4e3c91be4864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:13.982556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654bcb2-2072-4154-812d-4e3c91be4864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:13.984491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654bcb2-2072-4154-812d-4e3c91be4864 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:13.995661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 961/1901] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:14.018538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d5c69-989b-4670-b30d-61729d276662 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:14.020194 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c06d5c69-989b-4670-b30d-61729d276662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:14.032474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d5c69-989b-4670-b30d-61729d276662 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:14.038265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:14.038667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:14.038937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:14.039349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] PATH_INFO: `/v3/projects/743c5d07fe994ec092b0258405e529e9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:14.040485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743c5d07fe994ec092b0258405e529e9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:14.042431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:14.086300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:14.130716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743c5d07fe994ec092b0258405e529e9', 'request_id': 'req-70cd6d56-2657-4232-a3f7-9e7640e0d584'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.139175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743c5d07fe994ec092b0258405e529e9', 'request_id': 'req-70cd6d56-2657-4232-a3f7-9e7640e0d584'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.148954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743c5d07fe994ec092b0258405e529e9', 'request_id': 'req-70cd6d56-2657-4232-a3f7-9e7640e0d584'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.199978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] The token cache is being invalidate because project 743c5d07fe994ec092b0258405e529e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:14.200331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.201175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.205856 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 941/1902] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:14 2022] DELETE /identity/v3/projects/743c5d07fe994ec092b0258405e529e9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:14.206958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654bcb2-2072-4154-812d-4e3c91be4864 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:14.223375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654bcb2-2072-4154-812d-4e3c91be4864 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:14.338376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:14.341320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:14.346922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:14.348624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:14.349335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:14.350658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] PATH_INFO: `/v3/users/d23a299b6f1244b985cb2aef7ace0484` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:14.352764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23a299b6f1244b985cb2aef7ace0484)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:14.356609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:14.389279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd6d56-2657-4232-a3f7-9e7640e0d584 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:14.398068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:14.399013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:14.399761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:14.403672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] PATH_INFO: `/v3/users/fd8cdd08073b4ce59351a2b3d9dbf6b7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:14.407512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd8cdd08073b4ce59351a2b3d9dbf6b7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:14.410342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:14.427733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23a299b6f1244b985cb2aef7ace0484'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.433825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:14.457791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23a299b6f1244b985cb2aef7ace0484'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.460045 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23a299b6f1244b985cb2aef7ace0484'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.474535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23a299b6f1244b985cb2aef7ace0484'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.475360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23a299b6f1244b985cb2aef7ace0484'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.491271 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 962/1903] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:14 2022] DELETE /identity/v3/users/d23a299b6f1244b985cb2aef7ace0484 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:14.492227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:14.494665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:14.522288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd8cdd08073b4ce59351a2b3d9dbf6b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.550233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd8cdd08073b4ce59351a2b3d9dbf6b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.551292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd8cdd08073b4ce59351a2b3d9dbf6b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.569514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd8cdd08073b4ce59351a2b3d9dbf6b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.570232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a51a930f-9463-465d-ade3-e847c5fce3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd8cdd08073b4ce59351a2b3d9dbf6b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.597762 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 942/1904] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:14 2022] DELETE /identity/v3/users/fd8cdd08073b4ce59351a2b3d9dbf6b7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:14.612359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8870962-d986-452b-9530-4da290bca487 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:14.615055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dfe61-e5bc-4098-be96-8a94a2a3910a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:14.615876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dfe61-e5bc-4098-be96-8a94a2a3910a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:14.615876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dfe61-e5bc-4098-be96-8a94a2a3910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:14.642328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f07dfe61-e5bc-4098-be96-8a94a2a3910a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:14.644695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f07dfe61-e5bc-4098-be96-8a94a2a3910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:14.736127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:14.738061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:14.739363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:14.740572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] PATH_INFO: `/v3/projects/7ff0ea17149e4d09a08f30ae64a9f81c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:14.746158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff0ea17149e4d09a08f30ae64a9f81c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:14.748071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:14.795519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 943/1905] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:14.816584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dfe61-e5bc-4098-be96-8a94a2a3910a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:14.818809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f07dfe61-e5bc-4098-be96-8a94a2a3910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:14.854339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:14.854912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff0ea17149e4d09a08f30ae64a9f81c', 'request_id': 'req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.868379 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff0ea17149e4d09a08f30ae64a9f81c', 'request_id': 'req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.877655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff0ea17149e4d09a08f30ae64a9f81c', 'request_id': 'req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.907435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] The token cache is being invalidate because project 7ff0ea17149e4d09a08f30ae64a9f81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:14.909885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.915653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:14.918507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 963/1906] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:14 2022] DELETE /identity/v3/projects/7ff0ea17149e4d09a08f30ae64a9f81c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:14.922216 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:14.925645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:14.931076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dfe61-e5bc-4098-be96-8a94a2a3910a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:14.941068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:14.998464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e2f3c-da3d-4bf9-b809-0f6d04b038a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:14.999246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e2f3c-da3d-4bf9-b809-0f6d04b038a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.000067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e2f3c-da3d-4bf9-b809-0f6d04b038a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.000537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e2f3c-da3d-4bf9-b809-0f6d04b038a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.010153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6a3e2f3c-da3d-4bf9-b809-0f6d04b038a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.055622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf3a6c-ae3b-477b-aa99-ecca3fcddb6a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:15.075867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:15.078380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.078672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.078951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] PATH_INFO: `/v3/users/378d76cdb31d4bafaed47ccc5e65dbde` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.081966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378d76cdb31d4bafaed47ccc5e65dbde)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.084472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.157292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e2f3c-da3d-4bf9-b809-0f6d04b038a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.158971 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e2f3c-da3d-4bf9-b809-0f6d04b038a6 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.176833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 944/1907] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:15.197447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67398b4-798c-4a2a-8d08-68fca233a54b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.197447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67398b4-798c-4a2a-8d08-68fca233a54b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.197447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67398b4-798c-4a2a-8d08-68fca233a54b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.197447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 945/1908] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:00:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:15.198174 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67398b4-798c-4a2a-8d08-68fca233a54b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:15.201674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f67398b4-798c-4a2a-8d08-68fca233a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.202336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378d76cdb31d4bafaed47ccc5e65dbde'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.221836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378d76cdb31d4bafaed47ccc5e65dbde'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.222695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378d76cdb31d4bafaed47ccc5e65dbde'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.226607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67398b4-798c-4a2a-8d08-68fca233a54b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:15.234012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:15.235409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378d76cdb31d4bafaed47ccc5e65dbde'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.235752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.236144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.236561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] PATH_INFO: `/v3/users/076c38cdddeb4e8db8c6b553f020040c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.237406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378d76cdb31d4bafaed47ccc5e65dbde'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.238265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=076c38cdddeb4e8db8c6b553f020040c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.243586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.262609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 964/1909] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:14 2022] DELETE /identity/v3/users/378d76cdb31d4bafaed47ccc5e65dbde => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:15.263825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:15.265539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.317361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076c38cdddeb4e8db8c6b553f020040c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.337592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076c38cdddeb4e8db8c6b553f020040c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.339118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076c38cdddeb4e8db8c6b553f020040c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.351816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076c38cdddeb4e8db8c6b553f020040c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.352904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-98a8a566-4808-4cdf-a18e-2c7fec46b5fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076c38cdddeb4e8db8c6b553f020040c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.359175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f72577-cd1b-4677-9ff6-be323a2e34f3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:15.360560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:15.365914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:15.367272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.367716 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.368053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] PATH_INFO: `/v3/projects/fba2a485d51c4e09b7d087c82eec2aab` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.370187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba2a485d51c4e09b7d087c82eec2aab)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.372570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.387470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 946/1910] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:15 2022] DELETE /identity/v3/users/076c38cdddeb4e8db8c6b553f020040c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:15.392367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc331b-8dd0-4544-a8b4-25f9a1fb9321 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.393022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc331b-8dd0-4544-a8b4-25f9a1fb9321 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.393756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc331b-8dd0-4544-a8b4-25f9a1fb9321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.415350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:15.442706 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba2a485d51c4e09b7d087c82eec2aab', 'request_id': 'req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.444153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6efc331b-8dd0-4544-a8b4-25f9a1fb9321 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:15.445918 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6efc331b-8dd0-4544-a8b4-25f9a1fb9321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.450578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba2a485d51c4e09b7d087c82eec2aab', 'request_id': 'req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.459524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba2a485d51c4e09b7d087c82eec2aab', 'request_id': 'req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.478915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] The token cache is being invalidate because project fba2a485d51c4e09b7d087c82eec2aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:15.479195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.479925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8bf60e2-c4ab-4eb0-9b1b-eecfbfb58527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.482828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 965/1911] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:15 2022] DELETE /identity/v3/projects/fba2a485d51c4e09b7d087c82eec2aab => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:15.484274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e661-08b6-466a-9bb6-de4ecad5d91f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.484558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e661-08b6-466a-9bb6-de4ecad5d91f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.484827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e661-08b6-466a-9bb6-de4ecad5d91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.509782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4042e661-08b6-466a-9bb6-de4ecad5d91f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:15.511160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4042e661-08b6-466a-9bb6-de4ecad5d91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.593119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 966/1912] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:15.599124 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991595b-468a-493d-8104-8c801692b95e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.599521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991595b-468a-493d-8104-8c801692b95e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.599890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991595b-468a-493d-8104-8c801692b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.604282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 947/1913] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:00:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:15.607081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc331b-8dd0-4544-a8b4-25f9a1fb9321 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:15.610745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6efc331b-8dd0-4544-a8b4-25f9a1fb9321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.630574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7991595b-468a-493d-8104-8c801692b95e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:15.631887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7991595b-468a-493d-8104-8c801692b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.640410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 967/1914] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:15.641221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991595b-468a-493d-8104-8c801692b95e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:15.642506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7991595b-468a-493d-8104-8c801692b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.666353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991595b-468a-493d-8104-8c801692b95e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:15.673986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577bc2a-b341-4059-9ec0-7933ae30b737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:15.674613 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577bc2a-b341-4059-9ec0-7933ae30b737 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.675078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577bc2a-b341-4059-9ec0-7933ae30b737 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.675361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577bc2a-b341-4059-9ec0-7933ae30b737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.685104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577bc2a-b341-4059-9ec0-7933ae30b737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.686697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577bc2a-b341-4059-9ec0-7933ae30b737 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.700202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 968/1915] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:15.701678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a3d2d-8e9e-40b6-90d8-c1e2b23b916c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.702092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a3d2d-8e9e-40b6-90d8-c1e2b23b916c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.702408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a3d2d-8e9e-40b6-90d8-c1e2b23b916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.714981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc331b-8dd0-4544-a8b4-25f9a1fb9321 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:15.719641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:15.720588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.721106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.721768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.724745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e02a3d2d-8e9e-40b6-90d8-c1e2b23b916c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:15.726049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e02a3d2d-8e9e-40b6-90d8-c1e2b23b916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.736466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.738167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.740749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 969/1916] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:15.744776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a3d2d-8e9e-40b6-90d8-c1e2b23b916c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:15.749914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 948/1917] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:15.757048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:15.759924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a3d2d-8e9e-40b6-90d8-c1e2b23b916c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:15.760670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:15.765575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:15.766456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.766936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.767374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.768233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:15.768718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.770669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.777139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0288d-8a87-43e2-8e0f-8533cdfb5b2e service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:15.784247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:15.785096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.785477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.785840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] PATH_INFO: `/v3/projects/6d5f7697b7a64b43b3351cd341ed77c4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.792178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 970/1918] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:00:15.793586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:15.798122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5f7697b7a64b43b3351cd341ed77c4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.805002 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.806397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b5cc-6d0e-4555-b470-6e53015cdb5d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:15.811450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9615e-4d81-4dd7-9065-0bdb20fe3fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:15.812119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9615e-4d81-4dd7-9065-0bdb20fe3fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:15.812498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9615e-4d81-4dd7-9065-0bdb20fe3fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:15.812773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9615e-4d81-4dd7-9065-0bdb20fe3fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:15.813814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9615e-4d81-4dd7-9065-0bdb20fe3fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:15.815902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9615e-4d81-4dd7-9065-0bdb20fe3fe3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:15.876051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 971/1919] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:15 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:15.880947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9615e-4d81-4dd7-9065-0bdb20fe3fe3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:15.981214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5f7697b7a64b43b3351cd341ed77c4', 'request_id': 'req-16da9e78-79db-4ff4-ab01-0526c1c3c691'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:15.996231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5f7697b7a64b43b3351cd341ed77c4', 'request_id': 'req-16da9e78-79db-4ff4-ab01-0526c1c3c691'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.024442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5f7697b7a64b43b3351cd341ed77c4', 'request_id': 'req-16da9e78-79db-4ff4-ab01-0526c1c3c691'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.030778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:16.058186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] The token cache is being invalidate because project 6d5f7697b7a64b43b3351cd341ed77c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:16.058478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.060338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.063394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 949/1920] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:15 2022] DELETE /identity/v3/projects/6d5f7697b7a64b43b3351cd341ed77c4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:16.063972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:16.069589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9615e-4d81-4dd7-9065-0bdb20fe3fe3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:16.072392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.104208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:16.213275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:16.215103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.215419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.219696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.220373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:16.225577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:16.241598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da9e78-79db-4ff4-ab01-0526c1c3c691 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:16.252305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:16.252959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.253259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.253531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] PATH_INFO: `/v3/projects/c095f7cc859849d3964d0399e8e9127f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.255526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c095f7cc859849d3964d0399e8e9127f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:16.257942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:16.290366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 972/1921] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:15 2022] POST /identity/v3/users => generated 293 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:16.293991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:16.296423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.310781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05326ab-0d5d-4c2e-9ba0-2f9f5bc3bee5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:16.318292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:16.319187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.319538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.319852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] PATH_INFO: `/v3/users/a1776d87da5e42d9b2c01c70624f4303` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.322346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1776d87da5e42d9b2c01c70624f4303)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:16.323707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:16.354723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c095f7cc859849d3964d0399e8e9127f', 'request_id': 'req-053f624b-1d4b-4a8f-b838-9c2511e7b716'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.366053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c095f7cc859849d3964d0399e8e9127f', 'request_id': 'req-053f624b-1d4b-4a8f-b838-9c2511e7b716'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.376195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c095f7cc859849d3964d0399e8e9127f', 'request_id': 'req-053f624b-1d4b-4a8f-b838-9c2511e7b716'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.400055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] The token cache is being invalidate because project c095f7cc859849d3964d0399e8e9127f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:16.400055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.400964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.403098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 950/1922] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:16 2022] DELETE /identity/v3/projects/c095f7cc859849d3964d0399e8e9127f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:16.404004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:16.405487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.416298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1776d87da5e42d9b2c01c70624f4303'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.434575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1776d87da5e42d9b2c01c70624f4303'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.435838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1776d87da5e42d9b2c01c70624f4303'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.462749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1776d87da5e42d9b2c01c70624f4303'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.463384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1776d87da5e42d9b2c01c70624f4303'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.491361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 973/1923] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:16 2022] DELETE /identity/v3/users/a1776d87da5e42d9b2c01c70624f4303 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:16.494887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:16.495842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.542251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f624b-1d4b-4a8f-b838-9c2511e7b716 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:16.608330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e847-8953-4fa2-8d3c-c96a1071f24b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:16.621597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9b07e-6d95-4d7a-be84-d0bd56f2209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:16.622952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b07e-6d95-4d7a-be84-d0bd56f2209f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.623264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b07e-6d95-4d7a-be84-d0bd56f2209f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.623540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b07e-6d95-4d7a-be84-d0bd56f2209f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.624379 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9b07e-6d95-4d7a-be84-d0bd56f2209f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:16.625990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9b07e-6d95-4d7a-be84-d0bd56f2209f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:16.628536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:16.641158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 974/1924] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:16.643077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637d50-4584-4912-9b43-fac73866d8ff None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.643383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637d50-4584-4912-9b43-fac73866d8ff None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.644426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4637d50-4584-4912-9b43-fac73866d8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.668266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e4637d50-4584-4912-9b43-fac73866d8ff None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:16.669999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e4637d50-4584-4912-9b43-fac73866d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.675346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:16.681056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 975/1925] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:16.681831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4637d50-4584-4912-9b43-fac73866d8ff None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:16.683120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e4637d50-4584-4912-9b43-fac73866d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.695183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:16.695417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4637d50-4584-4912-9b43-fac73866d8ff None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:16.695993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.696353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.696700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] PATH_INFO: `/v3/users/6711254204924ed589d3569aa10c8343` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.697935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6711254204924ed589d3569aa10c8343)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:16.699959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:16.701749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:16.702617 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.702900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.703173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] PATH_INFO: `/v3/projects/35768c5c593f44369d4b31c8a5f17eb0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.704296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=35768c5c593f44369d4b31c8a5f17eb0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:16.707763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:16.761534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35768c5c593f44369d4b31c8a5f17eb0', 'request_id': 'req-13d8c5ba-0c6d-430e-891c-15285dd17b0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.763788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6711254204924ed589d3569aa10c8343'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.769626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35768c5c593f44369d4b31c8a5f17eb0', 'request_id': 'req-13d8c5ba-0c6d-430e-891c-15285dd17b0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.777724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35768c5c593f44369d4b31c8a5f17eb0', 'request_id': 'req-13d8c5ba-0c6d-430e-891c-15285dd17b0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.778829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6711254204924ed589d3569aa10c8343'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.779804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6711254204924ed589d3569aa10c8343'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.790109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6711254204924ed589d3569aa10c8343'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.790826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6711254204924ed589d3569aa10c8343'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.793049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] The token cache is being invalidate because project 35768c5c593f44369d4b31c8a5f17eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:16.793352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.793994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-13d8c5ba-0c6d-430e-891c-15285dd17b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:16.798746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 976/1926] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:16 2022] DELETE /identity/v3/projects/35768c5c593f44369d4b31c8a5f17eb0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:16.798746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5829-88e7-4770-a123-4c53938dca98 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.798746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5829-88e7-4770-a123-4c53938dca98 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.798746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b5829-88e7-4770-a123-4c53938dca98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.809413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 951/1927] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:16 2022] DELETE /identity/v3/users/6711254204924ed589d3569aa10c8343 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:16.810344 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:16.817736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.824864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a57b5829-88e7-4770-a123-4c53938dca98 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:16.826171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a57b5829-88e7-4770-a123-4c53938dca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.898552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 977/1928] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:16.900212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9533d67-c1b9-425d-9c90-7233e8a1b005 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:16.902563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28808b1-dfc1-4a8f-a962-2a184a27de0c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.902853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28808b1-dfc1-4a8f-a962-2a184a27de0c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.903122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28808b1-dfc1-4a8f-a962-2a184a27de0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.905776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:16.906392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.906669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.907014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.907923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:16.909545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:16.924838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 952/1929] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:16.924838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:16.924838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.926795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e28808b1-dfc1-4a8f-a962-2a184a27de0c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:16.928327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e28808b1-dfc1-4a8f-a962-2a184a27de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.938569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2687766-e7f0-484c-8e67-b2c3e8dcfa54 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:16.939029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 978/1930] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:16.939914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28808b1-dfc1-4a8f-a962-2a184a27de0c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:16.941846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e28808b1-dfc1-4a8f-a962-2a184a27de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:16.947640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:16.948433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:16.949178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:16.949178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] PATH_INFO: `/v3/users/8a13d76dd03f487993020f90af482f1c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:16.950386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a13d76dd03f487993020f90af482f1c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:16.952378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.010066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a13d76dd03f487993020f90af482f1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.019361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28808b1-dfc1-4a8f-a962-2a184a27de0c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.023049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:17.023273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.023894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.024173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.024498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.025990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a13d76dd03f487993020f90af482f1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.027006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a13d76dd03f487993020f90af482f1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.038134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a13d76dd03f487993020f90af482f1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.039052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a13d76dd03f487993020f90af482f1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.039455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.041274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.052376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 979/1931] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:17.053201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.053623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 953/1932] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:16 2022] DELETE /identity/v3/users/8a13d76dd03f487993020f90af482f1c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:17.054666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.057392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.059138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.067794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819b83-41fb-4bcc-bb5b-ef24c449830b service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.076643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:17.167719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a91ef0-f924-4380-bc7a-3ccc9fcc2701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.170086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91ef0-f924-4380-bc7a-3ccc9fcc2701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.170372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91ef0-f924-4380-bc7a-3ccc9fcc2701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.170710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91ef0-f924-4380-bc7a-3ccc9fcc2701 admin admin] PATH_INFO: `/v3/projects/e0387af9c20b4c51a595895dd7f3b811/users/609da272564f49879b67b93f7d54d70e/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.179867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9207ff7-4904-4d3b-8e89-d95ece961af4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.187774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.188435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.188704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.189068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.189753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:17.189986 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.191790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.213087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a91ef0-f924-4380-bc7a-3ccc9fcc2701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0387af9c20b4c51a595895dd7f3b811, user_id=609da272564f49879b67b93f7d54d70e, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.216838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a91ef0-f924-4380-bc7a-3ccc9fcc2701 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.223509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 954/1933] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:17.225235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.227703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.242017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 980/1934] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:17 2022] PUT /identity/v3/projects/e0387af9c20b4c51a595895dd7f3b811/users/609da272564f49879b67b93f7d54d70e/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:17.243039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a91ef0-f924-4380-bc7a-3ccc9fcc2701 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.250460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f8085-ca1e-4ee2-9586-b86cf7a16578 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.344837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.345631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.346009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.346389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] PATH_INFO: `/v3/projects/0d58a57b68d64226b396cf93c0c19bef` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.347781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d58a57b68d64226b396cf93c0c19bef)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.350820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.357495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a91ef0-f924-4380-bc7a-3ccc9fcc2701 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.364680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739b485-ba1e-4f24-a230-58f3762fc281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.365519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b485-ba1e-4f24-a230-58f3762fc281 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.365811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b485-ba1e-4f24-a230-58f3762fc281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.366092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739b485-ba1e-4f24-a230-58f3762fc281 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.366744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b485-ba1e-4f24-a230-58f3762fc281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.369398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739b485-ba1e-4f24-a230-58f3762fc281 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.407472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 981/1935] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:17.412948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a91b81-662a-4fa8-8966-e3f3e7541c98 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.412948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a91b81-662a-4fa8-8966-e3f3e7541c98 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.413386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a91b81-662a-4fa8-8966-e3f3e7541c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.430386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d58a57b68d64226b396cf93c0c19bef', 'request_id': 'req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.441459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d58a57b68d64226b396cf93c0c19bef', 'request_id': 'req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.448529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-64a91b81-662a-4fa8-8966-e3f3e7541c98 None None] MFA Rules not processed for user `609da272564f49879b67b93f7d54d70e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:17.449893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d58a57b68d64226b396cf93c0c19bef', 'request_id': 'req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.450108 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-64a91b81-662a-4fa8-8966-e3f3e7541c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.472591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] The token cache is being invalidate because project 0d58a57b68d64226b396cf93c0c19bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:17.474325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.475006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.478766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 955/1936] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:17 2022] DELETE /identity/v3/projects/0d58a57b68d64226b396cf93c0c19bef => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:17.482436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.482729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.491681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:17.556283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 982/1937] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:17.556283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6985-e07b-4d8b-a3d6-32f78ab867f2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.556283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6985-e07b-4d8b-a3d6-32f78ab867f2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.556283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f6985-e07b-4d8b-a3d6-32f78ab867f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.576008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4d5f6985-e07b-4d8b-a3d6-32f78ab867f2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:17.577340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4d5f6985-e07b-4d8b-a3d6-32f78ab867f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.586388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 983/1938] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:17.587010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb41f7e-9457-442a-a71b-f4edf0c31f9a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.587287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6985-e07b-4d8b-a3d6-32f78ab867f2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.588675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4d5f6985-e07b-4d8b-a3d6-32f78ab867f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.595715 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:17.596520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.597441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.597563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.597772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.598624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.600765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.601498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f6985-e07b-4d8b-a3d6-32f78ab867f2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.607803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.608519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.608872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.609248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] PATH_INFO: `/v3/projects/09553b8d36ed46839de7943a7843b0aa` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.610513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=09553b8d36ed46839de7943a7843b0aa)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.612732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.627016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 956/1939] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:17 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:17.627997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.630126 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.643297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6354be-1fe9-4675-ab8b-f4865e0e0809 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.648653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.649428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.649671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.650036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] PATH_INFO: `/v3/projects/691c986fd3084556a8ed901ef155896e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.651275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=691c986fd3084556a8ed901ef155896e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.653256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.672709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09553b8d36ed46839de7943a7843b0aa', 'request_id': 'req-5cf5d941-7def-4a57-bead-3a27abf11efe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.683528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09553b8d36ed46839de7943a7843b0aa', 'request_id': 'req-5cf5d941-7def-4a57-bead-3a27abf11efe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.690675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09553b8d36ed46839de7943a7843b0aa', 'request_id': 'req-5cf5d941-7def-4a57-bead-3a27abf11efe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.706386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] The token cache is being invalidate because project 09553b8d36ed46839de7943a7843b0aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:17.706976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.708335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.708555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691c986fd3084556a8ed901ef155896e', 'request_id': 'req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.710402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 984/1940] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:17 2022] DELETE /identity/v3/projects/09553b8d36ed46839de7943a7843b0aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:17.711131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.712806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.719218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691c986fd3084556a8ed901ef155896e', 'request_id': 'req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.729616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691c986fd3084556a8ed901ef155896e', 'request_id': 'req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.750426 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] The token cache is being invalidate because project 691c986fd3084556a8ed901ef155896e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:17.751064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.754816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8ebf8c5-9ffa-4478-a939-b43fe0f67465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:17.760675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 957/1941] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:17 2022] DELETE /identity/v3/projects/691c986fd3084556a8ed901ef155896e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:17.760675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d2fc-35ca-409c-90eb-a81e84948522 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.760675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d2fc-35ca-409c-90eb-a81e84948522 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.760675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36d2fc-35ca-409c-90eb-a81e84948522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.795909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6d36d2fc-35ca-409c-90eb-a81e84948522 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:17.807184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6d36d2fc-35ca-409c-90eb-a81e84948522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.837735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5d941-7def-4a57-bead-3a27abf11efe admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.906028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670824e6-dd54-4d09-8190-4ed4952d7c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.906559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670824e6-dd54-4d09-8190-4ed4952d7c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.906841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670824e6-dd54-4d09-8190-4ed4952d7c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.907115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670824e6-dd54-4d09-8190-4ed4952d7c56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.908021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670824e6-dd54-4d09-8190-4ed4952d7c56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.908128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 958/1942] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:17.908764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36d2fc-35ca-409c-90eb-a81e84948522 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.909731 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670824e6-dd54-4d09-8190-4ed4952d7c56 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.910233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6d36d2fc-35ca-409c-90eb-a81e84948522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.922671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36d2fc-35ca-409c-90eb-a81e84948522 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.928827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:17.929515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.929875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.930225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.930807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:17.932649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:17.944691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 985/1943] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:17 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:17.944691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135324-7235-4cc8-8f18-e4a7754205e2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:17.944691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135324-7235-4cc8-8f18-e4a7754205e2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:17.944691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4135324-7235-4cc8-8f18-e4a7754205e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:17.945143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 959/1944] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:17.945643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:17.948553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.958109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:17.964069 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f4135324-7235-4cc8-8f18-e4a7754205e2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:17.965431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c09906-77d7-48b6-a828-8fa5c56dd43e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:17.965575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f4135324-7235-4cc8-8f18-e4a7754205e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:17.978264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:18.030334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.031001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.031283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.031555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] PATH_INFO: `/v3/users/da7a7fc364504155994c85e1150f1f03` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.032689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7a7fc364504155994c85e1150f1f03)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.034630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.035318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 986/1945] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:18.036269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4135324-7235-4cc8-8f18-e4a7754205e2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.047171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4135324-7235-4cc8-8f18-e4a7754205e2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.052945 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.053562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.053844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.054112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.054751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:18.055054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.056635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.069977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 987/1946] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:18.070895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.073035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.085566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab8b27-0c0c-4829-8702-f3bd6914acef admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.085713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7a7fc364504155994c85e1150f1f03'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.090635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.091239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.091541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.091798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.092423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.094435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.097746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7a7fc364504155994c85e1150f1f03'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.098480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7a7fc364504155994c85e1150f1f03'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.106432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7a7fc364504155994c85e1150f1f03'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.107178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bd1cc8af-9c91-4ff8-a41b-2b88ba01c988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7a7fc364504155994c85e1150f1f03'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.118306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 988/1947] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:18 2022] POST /identity/v3/users => generated 299 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:18.118649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.120290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.125026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 960/1948] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:17 2022] DELETE /identity/v3/users/da7a7fc364504155994c85e1150f1f03 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:18.125654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7afc-7d86-4af3-a9dc-c3247acbad9b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.125991 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7afc-7d86-4af3-a9dc-c3247acbad9b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.126274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7afc-7d86-4af3-a9dc-c3247acbad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.133646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d76d1-e05b-4765-b9a5-065497cb2ef3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.150475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7b1b7afc-7d86-4af3-a9dc-c3247acbad9b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:18.151699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7b1b7afc-7d86-4af3-a9dc-c3247acbad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.202496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.203397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.203699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.204023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.204696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.206495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.217225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 989/1949] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:18.217942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.219781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.228858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 961/1950] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:18.229582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7afc-7d86-4af3-a9dc-c3247acbad9b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.230889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7b1b7afc-7d86-4af3-a9dc-c3247acbad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.233334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6d0a7-07e2-403e-9e70-c20f084f7f29 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.240050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d353-d03b-401d-b637-660693ebaf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.241438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d353-d03b-401d-b637-660693ebaf19 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.241634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d353-d03b-401d-b637-660693ebaf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.241911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d353-d03b-401d-b637-660693ebaf19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.242775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9d353-d03b-401d-b637-660693ebaf19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.244879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9d353-d03b-401d-b637-660693ebaf19 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.245017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7afc-7d86-4af3-a9dc-c3247acbad9b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.249749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a3cc5-f280-478e-aaaa-c020e70eaf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.250705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a3cc5-f280-478e-aaaa-c020e70eaf6c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.250705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a3cc5-f280-478e-aaaa-c020e70eaf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.250911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a3cc5-f280-478e-aaaa-c020e70eaf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.251517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a3cc5-f280-478e-aaaa-c020e70eaf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.253141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a3cc5-f280-478e-aaaa-c020e70eaf6c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.265725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 962/1951] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:18.265725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a3cc5-f280-478e-aaaa-c020e70eaf6c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.286710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 990/1952] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:18 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:18.287774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d353-d03b-401d-b637-660693ebaf19 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.290580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a3cc5-f280-478e-aaaa-c020e70eaf6c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.306994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:18.369432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d353-d03b-401d-b637-660693ebaf19 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.375005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.375741 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.376087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67309-dc9c-4373-83a0-c49f91ca703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.376229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.376517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.377242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:18.377544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.377879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67309-dc9c-4373-83a0-c49f91ca703f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.378334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67309-dc9c-4373-83a0-c49f91ca703f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.378783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67309-dc9c-4373-83a0-c49f91ca703f admin admin] PATH_INFO: `/v3/projects/a3b1dd5a82f842688aabe0d7dbcb410c/users/295e762f42f54269bfee69ff67fbf97e/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.379149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.381999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:18.398418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 991/1953] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:18.399850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.403842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec67309-dc9c-4373-83a0-c49f91ca703f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b1dd5a82f842688aabe0d7dbcb410c, user_id=295e762f42f54269bfee69ff67fbf97e, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.407218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec67309-dc9c-4373-83a0-c49f91ca703f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.411567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f41e4-eeb6-4f2f-a2ee-56f5acfff8d4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.417741 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5adcdc-a8da-4b7e-9312-bdbe99cdab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.419399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5adcdc-a8da-4b7e-9312-bdbe99cdab5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.419922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5adcdc-a8da-4b7e-9312-bdbe99cdab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.420280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5adcdc-a8da-4b7e-9312-bdbe99cdab5c admin admin] PATH_INFO: `/v3/projects/137fcb4249254a099c146a9f9d2ca3f7/users/dec80a40e0e0471ca12d1e19efe0497c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.424036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 963/1954] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:18 2022] PUT /identity/v3/projects/a3b1dd5a82f842688aabe0d7dbcb410c/users/295e762f42f54269bfee69ff67fbf97e/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:18.424744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67309-dc9c-4373-83a0-c49f91ca703f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.441432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5adcdc-a8da-4b7e-9312-bdbe99cdab5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=137fcb4249254a099c146a9f9d2ca3f7, user_id=dec80a40e0e0471ca12d1e19efe0497c, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.444828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5adcdc-a8da-4b7e-9312-bdbe99cdab5c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.461080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 992/1955] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:18 2022] PUT /identity/v3/projects/137fcb4249254a099c146a9f9d2ca3f7/users/dec80a40e0e0471ca12d1e19efe0497c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:18.462186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5adcdc-a8da-4b7e-9312-bdbe99cdab5c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.512039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67309-dc9c-4373-83a0-c49f91ca703f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.569835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5adcdc-a8da-4b7e-9312-bdbe99cdab5c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.575356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da67421-cd45-48ce-8a2b-4fbf62b5b6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.575861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67421-cd45-48ce-8a2b-4fbf62b5b6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.576140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67421-cd45-48ce-8a2b-4fbf62b5b6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.576517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da67421-cd45-48ce-8a2b-4fbf62b5b6f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.577086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67421-cd45-48ce-8a2b-4fbf62b5b6f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.579063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da67421-cd45-48ce-8a2b-4fbf62b5b6f2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.602574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc00c7f-d605-4261-bae1-dffd4ca6875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.603497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc00c7f-d605-4261-bae1-dffd4ca6875e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.603854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc00c7f-d605-4261-bae1-dffd4ca6875e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.604138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc00c7f-d605-4261-bae1-dffd4ca6875e admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.605127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc00c7f-d605-4261-bae1-dffd4ca6875e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.607328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc00c7f-d605-4261-bae1-dffd4ca6875e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.611705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 993/1956] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:18 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:18.613249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82c7d-6ac9-48a3-a4a5-8feb38847fff None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.613544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82c7d-6ac9-48a3-a4a5-8feb38847fff None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.614378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf82c7d-6ac9-48a3-a4a5-8feb38847fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.649060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 964/1957] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:18 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:18.650186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc00c7f-d605-4261-bae1-dffd4ca6875e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.654049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ddf82c7d-6ac9-48a3-a4a5-8feb38847fff None None] MFA Rules not processed for user `295e762f42f54269bfee69ff67fbf97e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:18.655253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ddf82c7d-6ac9-48a3-a4a5-8feb38847fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.663127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc00c7f-d605-4261-bae1-dffd4ca6875e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.693403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:18.727604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b69394-7c9e-4d2b-90af-ec3e34f3cb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.728150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69394-7c9e-4d2b-90af-ec3e34f3cb3c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.728430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69394-7c9e-4d2b-90af-ec3e34f3cb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.728708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b69394-7c9e-4d2b-90af-ec3e34f3cb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.729421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b69394-7c9e-4d2b-90af-ec3e34f3cb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.730380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 994/1958] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:18.734002 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b69394-7c9e-4d2b-90af-ec3e34f3cb3c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.734110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf82c7d-6ac9-48a3-a4a5-8feb38847fff None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.736293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ddf82c7d-6ac9-48a3-a4a5-8feb38847fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.746166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 965/1959] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:18.748004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b69394-7c9e-4d2b-90af-ec3e34f3cb3c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.752656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf82c7d-6ac9-48a3-a4a5-8feb38847fff None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.758479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.759241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b69394-7c9e-4d2b-90af-ec3e34f3cb3c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.759354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.759672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.760020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] PATH_INFO: `/v3/projects/aa20711e97e34858bd2b0efd795fc540` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.761307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa20711e97e34858bd2b0efd795fc540)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.765590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.767611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a7dd6-c924-475f-a2d9-32530d505f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.769110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a7dd6-c924-475f-a2d9-32530d505f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.769587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a7dd6-c924-475f-a2d9-32530d505f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.770532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a7dd6-c924-475f-a2d9-32530d505f98 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.771331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a7dd6-c924-475f-a2d9-32530d505f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.774459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a7dd6-c924-475f-a2d9-32530d505f98 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.808716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 966/1960] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:18 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:18.808716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a7dd6-c924-475f-a2d9-32530d505f98 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.820859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a7dd6-c924-475f-a2d9-32530d505f98 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.847886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:18.863187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa20711e97e34858bd2b0efd795fc540', 'request_id': 'req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.874552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa20711e97e34858bd2b0efd795fc540', 'request_id': 'req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.884345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa20711e97e34858bd2b0efd795fc540', 'request_id': 'req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.907873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] The token cache is being invalidate because project aa20711e97e34858bd2b0efd795fc540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:18.908284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.909384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:18.911674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 995/1961] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:18 2022] DELETE /identity/v3/projects/aa20711e97e34858bd2b0efd795fc540 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:18.912755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.914832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.935902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.936539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.937047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.937386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.938052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.939987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.952261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 967/1962] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:18.953372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:18.955161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:18.961742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e5d5-7d72-4b46-9e8b-5731b3a5f3a7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.969281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cbfa7-c604-45bb-90d7-bcb46b5c777e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:18.969633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d360e-d889-41f3-8837-081059f1bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.971580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d360e-d889-41f3-8837-081059f1bf86 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.971869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d360e-d889-41f3-8837-081059f1bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.972156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d360e-d889-41f3-8837-081059f1bf86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.973287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d360e-d889-41f3-8837-081059f1bf86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.974850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:18.975571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:18.976142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:18.976363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] PATH_INFO: `/v3/projects/137fcb4249254a099c146a9f9d2ca3f7/users/dec80a40e0e0471ca12d1e19efe0497c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:18.980136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] RBAC: Authorizing `identity:create_grant(project_id=137fcb4249254a099c146a9f9d2ca3f7, user_id=dec80a40e0e0471ca12d1e19efe0497c, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:18.982867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.989425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d360e-d889-41f3-8837-081059f1bf86 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:18.998445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 968/1963] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:18 2022] PUT /identity/v3/projects/137fcb4249254a099c146a9f9d2ca3f7/users/dec80a40e0e0471ca12d1e19efe0497c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:18.999371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.001739 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:19.073506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 996/1964] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:18 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:19.074792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a6973-5862-4034-9761-f1d638431777 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.075078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a6973-5862-4034-9761-f1d638431777 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.075354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a6973-5862-4034-9761-f1d638431777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.100674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3a0a6973-5862-4034-9761-f1d638431777 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:19.102110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3a0a6973-5862-4034-9761-f1d638431777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:19.133403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28919648-f63a-4b96-b6e1-1920a0dc771e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.197495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:19.203847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 997/1965] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:19.205094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a6973-5862-4034-9761-f1d638431777 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.206608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3a0a6973-5862-4034-9761-f1d638431777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:19.222348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a6973-5862-4034-9761-f1d638431777 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.225286 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97cc49-6090-4ff4-b8bb-0fe8852b79a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.225884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97cc49-6090-4ff4-b8bb-0fe8852b79a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.226297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97cc49-6090-4ff4-b8bb-0fe8852b79a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.226598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97cc49-6090-4ff4-b8bb-0fe8852b79a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.227346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97cc49-6090-4ff4-b8bb-0fe8852b79a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.229347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97cc49-6090-4ff4-b8bb-0fe8852b79a8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.230122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e674e5-531e-4d39-b332-bf75c53796fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.230843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e674e5-531e-4d39-b332-bf75c53796fc admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.231070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e674e5-531e-4d39-b332-bf75c53796fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.231488 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e674e5-531e-4d39-b332-bf75c53796fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.232247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e674e5-531e-4d39-b332-bf75c53796fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.234032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e674e5-531e-4d39-b332-bf75c53796fc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.243422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 969/1966] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:19.245154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a06308-a240-4e50-adba-a03b6a25375b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.245444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a06308-a240-4e50-adba-a03b6a25375b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.245717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a06308-a240-4e50-adba-a03b6a25375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.251482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 998/1967] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:19.251482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e674e5-531e-4d39-b332-bf75c53796fc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.265372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e674e5-531e-4d39-b332-bf75c53796fc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.288307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d3a06308-a240-4e50-adba-a03b6a25375b None None] MFA Rules not processed for user `dec80a40e0e0471ca12d1e19efe0497c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:19.290150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3a06308-a240-4e50-adba-a03b6a25375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:19.309846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447708d-e699-4998-a141-0d62b8777493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.310714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447708d-e699-4998-a141-0d62b8777493 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.311096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447708d-e699-4998-a141-0d62b8777493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.311456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447708d-e699-4998-a141-0d62b8777493 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.312202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447708d-e699-4998-a141-0d62b8777493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.314256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447708d-e699-4998-a141-0d62b8777493 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.340994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 999/1968] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:19 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:19.342663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030970e-5a4c-487e-a048-8cab238d56fc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.343165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030970e-5a4c-487e-a048-8cab238d56fc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.343727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030970e-5a4c-487e-a048-8cab238d56fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.368908 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f030970e-5a4c-487e-a048-8cab238d56fc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:19.370840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f030970e-5a4c-487e-a048-8cab238d56fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:19.382643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1000/1969] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:19.388483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030970e-5a4c-487e-a048-8cab238d56fc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.400209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030970e-5a4c-487e-a048-8cab238d56fc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.405643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2eb18-db73-4bc5-b531-0e8dc36a260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.406281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2eb18-db73-4bc5-b531-0e8dc36a260a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.406708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2eb18-db73-4bc5-b531-0e8dc36a260a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.406987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2eb18-db73-4bc5-b531-0e8dc36a260a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.407636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2eb18-db73-4bc5-b531-0e8dc36a260a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.409184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 970/1970] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:19.409291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2eb18-db73-4bc5-b531-0e8dc36a260a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.410383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a06308-a240-4e50-adba-a03b6a25375b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.421754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1001/1971] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:19.422599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2eb18-db73-4bc5-b531-0e8dc36a260a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.425590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a06308-a240-4e50-adba-a03b6a25375b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.430569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.431235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.431519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.431794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] PATH_INFO: `/v3/projects/e834101158cc4d9da560e894e5fd7cf4/users/fb1d6e0544ba45ecacfa952d05fcbdb1/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.434762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2eb18-db73-4bc5-b531-0e8dc36a260a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.448641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4395-40e2-46fb-9c37-cd293a12d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.449455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e834101158cc4d9da560e894e5fd7cf4, user_id=fb1d6e0544ba45ecacfa952d05fcbdb1, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.449872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4395-40e2-46fb-9c37-cd293a12d7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.449872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4395-40e2-46fb-9c37-cd293a12d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.450116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e4395-40e2-46fb-9c37-cd293a12d7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.450992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e4395-40e2-46fb-9c37-cd293a12d7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.452145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.453044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e4395-40e2-46fb-9c37-cd293a12d7aa admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.466119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1002/1972] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:19.466953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4395-40e2-46fb-9c37-cd293a12d7aa admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.481279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 971/1973] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:19 2022] PUT /identity/v3/projects/e834101158cc4d9da560e894e5fd7cf4/users/fb1d6e0544ba45ecacfa952d05fcbdb1/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:19.481279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.481279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:19.481584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e4395-40e2-46fb-9c37-cd293a12d7aa admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.532094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:19.547157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.547955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.549452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.549794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.550382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:19.550688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.552390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf4fb2-8b25-45e6-a80b-5fa6618e91e4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.552507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.556113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440c7a0-b1ec-443b-b850-1fcaff7218e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.556729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c7a0-b1ec-443b-b850-1fcaff7218e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.557129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c7a0-b1ec-443b-b850-1fcaff7218e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.557408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c7a0-b1ec-443b-b850-1fcaff7218e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.590593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1003/1974] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:19.590593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.599764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fada4d-df3f-446f-9fba-a1d4b0df86c4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.604695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c756e-c137-4a05-85ea-84027d63aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.605384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c756e-c137-4a05-85ea-84027d63aa7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.605665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c756e-c137-4a05-85ea-84027d63aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.605941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c756e-c137-4a05-85ea-84027d63aa7d admin admin] PATH_INFO: `/v3/projects/4e52cb728d5f4606934872eb17665b81/users/099d526f2ae142da9726b931c6bb5f56/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.624075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c756e-c137-4a05-85ea-84027d63aa7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e52cb728d5f4606934872eb17665b81, user_id=099d526f2ae142da9726b931c6bb5f56, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.627833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:19.628184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c756e-c137-4a05-85ea-84027d63aa7d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.640323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440c7a0-b1ec-443b-b850-1fcaff7218e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.642466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440c7a0-b1ec-443b-b850-1fcaff7218e3 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.647821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1004/1975] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:19 2022] PUT /identity/v3/projects/4e52cb728d5f4606934872eb17665b81/users/099d526f2ae142da9726b931c6bb5f56/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:19.649427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c756e-c137-4a05-85ea-84027d63aa7d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.655019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 972/1976] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:19.656724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327c07b-af24-48a8-b2d3-b5d17fbb6214 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.658394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327c07b-af24-48a8-b2d3-b5d17fbb6214 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.658684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327c07b-af24-48a8-b2d3-b5d17fbb6214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.697344 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6327c07b-af24-48a8-b2d3-b5d17fbb6214 None None] MFA Rules not processed for user `fb1d6e0544ba45ecacfa952d05fcbdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:19.698465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6327c07b-af24-48a8-b2d3-b5d17fbb6214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:19.759767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c756e-c137-4a05-85ea-84027d63aa7d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.765578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa122c-88eb-40bd-b29d-d502ffc06c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.766205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa122c-88eb-40bd-b29d-d502ffc06c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.766484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa122c-88eb-40bd-b29d-d502ffc06c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.767321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa122c-88eb-40bd-b29d-d502ffc06c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.768098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa122c-88eb-40bd-b29d-d502ffc06c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.769758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa122c-88eb-40bd-b29d-d502ffc06c97 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.787029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1005/1977] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:19.790511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa122c-88eb-40bd-b29d-d502ffc06c97 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.794505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 973/1978] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:19.796081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086562-21cd-46a6-b2ec-74150bc207da None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.796828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086562-21cd-46a6-b2ec-74150bc207da None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.797379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea086562-21cd-46a6-b2ec-74150bc207da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.800558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa122c-88eb-40bd-b29d-d502ffc06c97 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.826937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0019-a828-47fa-8028-15257b67c2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.829319 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0019-a828-47fa-8028-15257b67c2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.829608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0019-a828-47fa-8028-15257b67c2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.830040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d0019-a828-47fa-8028-15257b67c2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.830692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d0019-a828-47fa-8028-15257b67c2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.833599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d0019-a828-47fa-8028-15257b67c2b0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.846418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ea086562-21cd-46a6-b2ec-74150bc207da None None] MFA Rules not processed for user `099d526f2ae142da9726b931c6bb5f56`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:19.847634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ea086562-21cd-46a6-b2ec-74150bc207da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:19.865757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1006/1979] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:19 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:19.866774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0019-a828-47fa-8028-15257b67c2b0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.917617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 974/1980] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:19.918630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea086562-21cd-46a6-b2ec-74150bc207da None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.929595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea086562-21cd-46a6-b2ec-74150bc207da None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.934757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f0cc1-aef9-4df0-a28d-21189d58a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.935536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f0cc1-aef9-4df0-a28d-21189d58a3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.935830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f0cc1-aef9-4df0-a28d-21189d58a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.936101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f0cc1-aef9-4df0-a28d-21189d58a3f9 admin admin] PATH_INFO: `/v3/projects/3f2aa46a0f544ff6a8c5b8048b47f516/users/86d5e756a66f492facfe8fe0368e8130/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.940170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d0019-a828-47fa-8028-15257b67c2b0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:19.947053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:19.947722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:19.948005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:19.948276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] PATH_INFO: `/v3/users/609da272564f49879b67b93f7d54d70e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:19.949452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609da272564f49879b67b93f7d54d70e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.951372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.953713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f0cc1-aef9-4df0-a28d-21189d58a3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2aa46a0f544ff6a8c5b8048b47f516, user_id=86d5e756a66f492facfe8fe0368e8130, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:19.956687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f0cc1-aef9-4df0-a28d-21189d58a3f9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:19.973288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 975/1981] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:19 2022] PUT /identity/v3/projects/3f2aa46a0f544ff6a8c5b8048b47f516/users/86d5e756a66f492facfe8fe0368e8130/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:19.974593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f0cc1-aef9-4df0-a28d-21189d58a3f9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:19.997058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:20.009449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609da272564f49879b67b93f7d54d70e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.022949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609da272564f49879b67b93f7d54d70e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.023783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609da272564f49879b67b93f7d54d70e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.026316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:20.034546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609da272564f49879b67b93f7d54d70e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.035536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609da272564f49879b67b93f7d54d70e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.039502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f0cc1-aef9-4df0-a28d-21189d58a3f9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.043561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.044382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.044671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.045000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.050617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.052511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1007/1982] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:19 2022] DELETE /identity/v3/users/609da272564f49879b67b93f7d54d70e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:20.053508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.055075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.135514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.136990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.139126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e657c-6db8-4e0c-ae13-d7b48241fca8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.144831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ef65b-aed4-4cf8-821f-22281807d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.146205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef65b-aed4-4cf8-821f-22281807d61c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.146490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef65b-aed4-4cf8-821f-22281807d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.146826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef65b-aed4-4cf8-821f-22281807d61c admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.147536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ef65b-aed4-4cf8-821f-22281807d61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.147985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 976/1983] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:20.148859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.150105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ef65b-aed4-4cf8-821f-22281807d61c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.150234 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.185160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1008/1984] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:20 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:20.187512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e254-9137-47a1-8e9a-134fb18a58c4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.187798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e254-9137-47a1-8e9a-134fb18a58c4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.188076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e254-9137-47a1-8e9a-134fb18a58c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.218623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-56c8e254-9137-47a1-8e9a-134fb18a58c4 None None] MFA Rules not processed for user `86d5e756a66f492facfe8fe0368e8130`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:20.219835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-56c8e254-9137-47a1-8e9a-134fb18a58c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.229630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb595-969b-4ad3-b769-67ab8d11fd4a service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.238115 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7f4bf-c1b2-4521-8382-5846cf6b8aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.239449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f4bf-c1b2-4521-8382-5846cf6b8aac admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.239602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f4bf-c1b2-4521-8382-5846cf6b8aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.239865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f4bf-c1b2-4521-8382-5846cf6b8aac admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.241218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7f4bf-c1b2-4521-8382-5846cf6b8aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.243342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7f4bf-c1b2-4521-8382-5846cf6b8aac admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.282929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 977/1985] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:20 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:20.284388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f45fc-1d09-4dcc-857e-b21545b7f858 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.284822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f45fc-1d09-4dcc-857e-b21545b7f858 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.285110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f45fc-1d09-4dcc-857e-b21545b7f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.315485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3b8f45fc-1d09-4dcc-857e-b21545b7f858 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:20.316733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1009/1986] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:20.317823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b8f45fc-1d09-4dcc-857e-b21545b7f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.321535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8e254-9137-47a1-8e9a-134fb18a58c4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.323912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-56c8e254-9137-47a1-8e9a-134fb18a58c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.339586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8e254-9137-47a1-8e9a-134fb18a58c4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.378728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:20.396445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 978/1987] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:20.396445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f45fc-1d09-4dcc-857e-b21545b7f858 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.404591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f45fc-1d09-4dcc-857e-b21545b7f858 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.409362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004aaf7-f1b4-4a9b-9e80-f0d9358caf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.409960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004aaf7-f1b4-4a9b-9e80-f0d9358caf26 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.410243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004aaf7-f1b4-4a9b-9e80-f0d9358caf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.410514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004aaf7-f1b4-4a9b-9e80-f0d9358caf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.411713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004aaf7-f1b4-4a9b-9e80-f0d9358caf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.413319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004aaf7-f1b4-4a9b-9e80-f0d9358caf26 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.423500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 979/1988] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:20.424358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004aaf7-f1b4-4a9b-9e80-f0d9358caf26 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.432427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.433129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.433413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.433687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] PATH_INFO: `/v3/users/fb1d6e0544ba45ecacfa952d05fcbdb1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.434317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004aaf7-f1b4-4a9b-9e80-f0d9358caf26 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.434873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1d6e0544ba45ecacfa952d05fcbdb1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.436793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.438919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.439501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.439778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.440043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.440655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.442576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.454865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:20.467550 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 980/1989] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:20 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:20.468467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.470292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.483190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5000e-295f-44ea-8ef6-f05448087c79 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.487853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.488443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.488587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1d6e0544ba45ecacfa952d05fcbdb1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.488764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.489074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.489699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.491580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.501185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1d6e0544ba45ecacfa952d05fcbdb1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.502415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1d6e0544ba45ecacfa952d05fcbdb1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.511100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1d6e0544ba45ecacfa952d05fcbdb1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.511804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1d6e0544ba45ecacfa952d05fcbdb1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:20.519351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 981/1990] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:20 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:20.519351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.519351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.525191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1010/1991] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:20 2022] DELETE /identity/v3/users/fb1d6e0544ba45ecacfa952d05fcbdb1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:20.526054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.527540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.585411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aa67b-d743-48e1-8df4-d02d2ebe614b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.592850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea1e57-7087-4bce-99d8-fac3fa610b46 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.597473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.598070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.598879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.599147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.599779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.601392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.610940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1011/1992] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:20.611880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.615605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.627474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa516c-4cc3-4562-9e37-ce979f5f039e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.632719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.633345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.633694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.633975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.634606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.635211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02759524-fa38-4ac3-86fb-2dbae430acc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.635822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759524-fa38-4ac3-86fb-2dbae430acc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.636104 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759524-fa38-4ac3-86fb-2dbae430acc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.636344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.636437 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02759524-fa38-4ac3-86fb-2dbae430acc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.638297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-02759524-fa38-4ac3-86fb-2dbae430acc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.650733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1012/1993] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:20.650733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.651052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02759524-fa38-4ac3-86fb-2dbae430acc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.651342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.651577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02759524-fa38-4ac3-86fb-2dbae430acc3 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.661769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 982/1994] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:20.662989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5113ed-1c4a-4371-b902-39220e0d4473 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.663272 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5113ed-1c4a-4371-b902-39220e0d4473 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.663547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5113ed-1c4a-4371-b902-39220e0d4473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.665889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e21a6-8574-4cf6-8ba3-dcc6b96755fa admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.670592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35474d6-f58c-4983-938c-15cfc70db848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.671428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35474d6-f58c-4983-938c-15cfc70db848 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.671717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35474d6-f58c-4983-938c-15cfc70db848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.672177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35474d6-f58c-4983-938c-15cfc70db848 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.672814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35474d6-f58c-4983-938c-15cfc70db848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.674832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35474d6-f58c-4983-938c-15cfc70db848 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.686758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6d5113ed-1c4a-4371-b902-39220e0d4473 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:20.688190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6d5113ed-1c4a-4371-b902-39220e0d4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:20.698689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 983/1995] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:20.701277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5113ed-1c4a-4371-b902-39220e0d4473 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.702890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1013/1996] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:20 2022] POST /identity/v3/users => generated 296 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:20.703776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35474d6-f58c-4983-938c-15cfc70db848 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.712291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5113ed-1c4a-4371-b902-39220e0d4473 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.717407 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35474d6-f58c-4983-938c-15cfc70db848 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.719535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cace858-639e-4829-82f2-9d52be5559d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.720568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cace858-639e-4829-82f2-9d52be5559d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.720568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cace858-639e-4829-82f2-9d52be5559d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.721032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cace858-639e-4829-82f2-9d52be5559d9 admin admin] PATH_INFO: `/v3/projects/0d7cc289236f4a5c811030716b3a8b70/users/6f51254a230a41dab942e71193b96b84/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.722655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755761f4-30f6-464e-b1a3-d64cc9733d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.724182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755761f4-30f6-464e-b1a3-d64cc9733d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.724675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755761f4-30f6-464e-b1a3-d64cc9733d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.725154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755761f4-30f6-464e-b1a3-d64cc9733d47 admin admin] PATH_INFO: `/v3/projects/cfdb95670c5e43cab2bfbee2ec10e4d7/users/afe22bf5aa9442bb9cde661bd7feca2f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.747284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755761f4-30f6-464e-b1a3-d64cc9733d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb95670c5e43cab2bfbee2ec10e4d7, user_id=afe22bf5aa9442bb9cde661bd7feca2f, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.751021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755761f4-30f6-464e-b1a3-d64cc9733d47 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.752661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cace858-639e-4829-82f2-9d52be5559d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7cc289236f4a5c811030716b3a8b70, user_id=6f51254a230a41dab942e71193b96b84, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.755461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cace858-639e-4829-82f2-9d52be5559d9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.757977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:20.774316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1014/1997] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:20 2022] PUT /identity/v3/projects/cfdb95670c5e43cab2bfbee2ec10e4d7/users/afe22bf5aa9442bb9cde661bd7feca2f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:20.778081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755761f4-30f6-464e-b1a3-d64cc9733d47 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.782436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 984/1998] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:20 2022] PUT /identity/v3/projects/0d7cc289236f4a5c811030716b3a8b70/users/6f51254a230a41dab942e71193b96b84/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:20.783463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cace858-639e-4829-82f2-9d52be5559d9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:20.877309 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755761f4-30f6-464e-b1a3-d64cc9733d47 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.880282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cace858-639e-4829-82f2-9d52be5559d9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:20.884566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb31a55-f732-4134-8d3d-23fa4b62ac9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.885277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb31a55-f732-4134-8d3d-23fa4b62ac9a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.908098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb31a55-f732-4134-8d3d-23fa4b62ac9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.908448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb31a55-f732-4134-8d3d-23fa4b62ac9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.935683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:20.963836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea49c7-2479-4317-a7ef-8723cd48cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:20.964935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea49c7-2479-4317-a7ef-8723cd48cd4b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:20.965507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea49c7-2479-4317-a7ef-8723cd48cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:20.965904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea49c7-2479-4317-a7ef-8723cd48cd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:20.966557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea49c7-2479-4317-a7ef-8723cd48cd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:20.968538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea49c7-2479-4317-a7ef-8723cd48cd4b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:20.985445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1015/1999] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:20.986331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea49c7-2479-4317-a7ef-8723cd48cd4b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.005219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea49c7-2479-4317-a7ef-8723cd48cd4b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.011632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b4661-9509-4e99-a8d6-172da4f3d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.012257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4661-9509-4e99-a8d6-172da4f3d284 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.012538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4661-9509-4e99-a8d6-172da4f3d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.012812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b4661-9509-4e99-a8d6-172da4f3d284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.013735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b4661-9509-4e99-a8d6-172da4f3d284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.015412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b4661-9509-4e99-a8d6-172da4f3d284 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.031600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1016/2000] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:21.031600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b04fc-7395-41fe-ab3c-ef2f89928142 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.031600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b04fc-7395-41fe-ab3c-ef2f89928142 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.031600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b04fc-7395-41fe-ab3c-ef2f89928142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.085852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb31a55-f732-4134-8d3d-23fa4b62ac9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.088221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb31a55-f732-4134-8d3d-23fa4b62ac9a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.108874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-475b04fc-7395-41fe-ab3c-ef2f89928142 None None] MFA Rules not processed for user `6f51254a230a41dab942e71193b96b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:21.111833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 985/2001] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:21.112699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-475b04fc-7395-41fe-ab3c-ef2f89928142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:21.113470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb31a55-f732-4134-8d3d-23fa4b62ac9a service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.140201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb31a55-f732-4134-8d3d-23fa4b62ac9a service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.151576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b70cf-e867-4454-89ef-5813f856bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.152764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b70cf-e867-4454-89ef-5813f856bd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.153277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b70cf-e867-4454-89ef-5813f856bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.153767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b70cf-e867-4454-89ef-5813f856bd36 admin admin] PATH_INFO: `/v3/projects/6c8c02953b6e47eca74b24130ca6a979/users/48aa0645160b4ef79362cbf373da80a3/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.174802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b70cf-e867-4454-89ef-5813f856bd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8c02953b6e47eca74b24130ca6a979, user_id=48aa0645160b4ef79362cbf373da80a3, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.178335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b70cf-e867-4454-89ef-5813f856bd36 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.199850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 986/2002] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:21 2022] PUT /identity/v3/projects/6c8c02953b6e47eca74b24130ca6a979/users/48aa0645160b4ef79362cbf373da80a3/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:21.200961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b70cf-e867-4454-89ef-5813f856bd36 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.232339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1017/2003] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:21.237913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b04fc-7395-41fe-ab3c-ef2f89928142 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.251957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b04fc-7395-41fe-ab3c-ef2f89928142 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.278856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:21.327583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b70cf-e867-4454-89ef-5813f856bd36 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.340298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.341812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.342467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.343758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] PATH_INFO: `/v3/projects/cfdb95670c5e43cab2bfbee2ec10e4d7/users/afe22bf5aa9442bb9cde661bd7feca2f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.347106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb95670c5e43cab2bfbee2ec10e4d7, user_id=afe22bf5aa9442bb9cde661bd7feca2f, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.351905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.358724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e434447-0908-4e17-8d76-14aa7971244e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.359585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434447-0908-4e17-8d76-14aa7971244e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.360102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434447-0908-4e17-8d76-14aa7971244e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.360457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e434447-0908-4e17-8d76-14aa7971244e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.361372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e434447-0908-4e17-8d76-14aa7971244e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.363740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e434447-0908-4e17-8d76-14aa7971244e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.376079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1018/2004] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:21.376900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e434447-0908-4e17-8d76-14aa7971244e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.378460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 987/2005] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:21 2022] PUT /identity/v3/projects/cfdb95670c5e43cab2bfbee2ec10e4d7/users/afe22bf5aa9442bb9cde661bd7feca2f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:21.381458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.383452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:21.389574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e434447-0908-4e17-8d76-14aa7971244e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.485299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4531-1f1a-4525-b668-6d9351561b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.486243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4531-1f1a-4525-b668-6d9351561b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.486703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4531-1f1a-4525-b668-6d9351561b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.487188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd4531-1f1a-4525-b668-6d9351561b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.488020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd4531-1f1a-4525-b668-6d9351561b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.490975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd4531-1f1a-4525-b668-6d9351561b37 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.548398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1019/2006] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:21 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:21.551856 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b566e-794f-4c75-b222-0629fbb185ca admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.566156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4531-1f1a-4525-b668-6d9351561b37 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.589423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:21.665331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd4531-1f1a-4525-b668-6d9351561b37 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.665555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.666880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.667359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.667781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] PATH_INFO: `/v3/projects/e0387af9c20b4c51a595895dd7f3b811` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.669554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0387af9c20b4c51a595895dd7f3b811)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.670885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c272c1-3133-424b-aff2-95f1edb7ba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.671920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c272c1-3133-424b-aff2-95f1edb7ba5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.672270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c272c1-3133-424b-aff2-95f1edb7ba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.672684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.672810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c272c1-3133-424b-aff2-95f1edb7ba5d admin admin] PATH_INFO: `/v3/projects/6c8c02953b6e47eca74b24130ca6a979/users/48aa0645160b4ef79362cbf373da80a3/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.675323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c272c1-3133-424b-aff2-95f1edb7ba5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8c02953b6e47eca74b24130ca6a979, user_id=48aa0645160b4ef79362cbf373da80a3, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.678727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c272c1-3133-424b-aff2-95f1edb7ba5d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.702365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1020/2007] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:21 2022] PUT /identity/v3/projects/6c8c02953b6e47eca74b24130ca6a979/users/48aa0645160b4ef79362cbf373da80a3/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:21.702365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb741-cb32-48fa-888a-a313db2e2f9d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.702365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb741-cb32-48fa-888a-a313db2e2f9d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.702365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fb741-cb32-48fa-888a-a313db2e2f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.730987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ff1fb741-cb32-48fa-888a-a313db2e2f9d None None] MFA Rules not processed for user `afe22bf5aa9442bb9cde661bd7feca2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:21.732943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ff1fb741-cb32-48fa-888a-a313db2e2f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:21.745454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0387af9c20b4c51a595895dd7f3b811', 'request_id': 'req-7428ac36-519c-4c1f-88d2-926fc7c05cc1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:21.753264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0387af9c20b4c51a595895dd7f3b811', 'request_id': 'req-7428ac36-519c-4c1f-88d2-926fc7c05cc1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:21.762810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:21.763978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0387af9c20b4c51a595895dd7f3b811', 'request_id': 'req-7428ac36-519c-4c1f-88d2-926fc7c05cc1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:21.786845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] The token cache is being invalidate because project e0387af9c20b4c51a595895dd7f3b811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:21.787167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:21.787818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:21.790240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 988/2008] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:21 2022] DELETE /identity/v3/projects/e0387af9c20b4c51a595895dd7f3b811 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:21.793511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.797333 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:21.845469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1021/2009] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:21.846656 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aa89c-6755-41d7-96ca-035aaf55b7bd None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.847122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aa89c-6755-41d7-96ca-035aaf55b7bd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.847391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aa89c-6755-41d7-96ca-035aaf55b7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.893240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-114aa89c-6755-41d7-96ca-035aaf55b7bd None None] MFA Rules not processed for user `48aa0645160b4ef79362cbf373da80a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:21.895139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-114aa89c-6755-41d7-96ca-035aaf55b7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:21.898228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428ac36-519c-4c1f-88d2-926fc7c05cc1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.904245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.904960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.905583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.905690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.906566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.908890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.935332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 989/2010] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:21 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:21.936223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.940409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:21.954628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6be7a-95d9-4c7c-89f8-5de3403288e7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:21.960146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:21.960656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:21.961030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:21.961485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] PATH_INFO: `/v3/users/dec80a40e0e0471ca12d1e19efe0497c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:21.962621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec80a40e0e0471ca12d1e19efe0497c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:21.964533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:21.981033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1022/2011] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:21.986462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aa89c-6755-41d7-96ca-035aaf55b7bd None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:21.987786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-114aa89c-6755-41d7-96ca-035aaf55b7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.018867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:22.023015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec80a40e0e0471ca12d1e19efe0497c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.039436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec80a40e0e0471ca12d1e19efe0497c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.040417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec80a40e0e0471ca12d1e19efe0497c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.049167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec80a40e0e0471ca12d1e19efe0497c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.049827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec80a40e0e0471ca12d1e19efe0497c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.064215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 990/2012] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:21 2022] DELETE /identity/v3/users/dec80a40e0e0471ca12d1e19efe0497c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:22.064697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aa89c-6755-41d7-96ca-035aaf55b7bd None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.064824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.066163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.134032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.134658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.134937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.135256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.137982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.159939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:22.168368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace943f-7171-445f-89a4-656f60faab01 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.175601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.177080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.177475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.177752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] PATH_INFO: `/v3/projects/e834101158cc4d9da560e894e5fd7cf4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.178999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e834101158cc4d9da560e894e5fd7cf4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.181079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.221937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.224313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.234862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e834101158cc4d9da560e894e5fd7cf4', 'request_id': 'req-fe65045a-428b-4532-a60b-801ad5f1da66'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.240927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1023/2013] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:22.242254 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.244474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.244700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e834101158cc4d9da560e894e5fd7cf4', 'request_id': 'req-fe65045a-428b-4532-a60b-801ad5f1da66'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.253985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e834101158cc4d9da560e894e5fd7cf4', 'request_id': 'req-fe65045a-428b-4532-a60b-801ad5f1da66'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.264206 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f71275-5294-4dcc-9cf4-35294f5b6e32 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.273595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] The token cache is being invalidate because project e834101158cc4d9da560e894e5fd7cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:22.273970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.275597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.279631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 991/2014] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:22 2022] DELETE /identity/v3/projects/e834101158cc4d9da560e894e5fd7cf4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:22.281792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.284532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.358435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54602c04-61f3-4fe5-8cb8-e68b302dde94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.359143 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602c04-61f3-4fe5-8cb8-e68b302dde94 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.359679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602c04-61f3-4fe5-8cb8-e68b302dde94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.359862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602c04-61f3-4fe5-8cb8-e68b302dde94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.360521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54602c04-61f3-4fe5-8cb8-e68b302dde94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.362725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54602c04-61f3-4fe5-8cb8-e68b302dde94 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.381928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1024/2015] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:22.381928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096cb89-1d58-416b-b268-7366c9eba2e9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.381928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096cb89-1d58-416b-b268-7366c9eba2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.381928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096cb89-1d58-416b-b268-7366c9eba2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.411809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9096cb89-1d58-416b-b268-7366c9eba2e9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:22.414064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9096cb89-1d58-416b-b268-7366c9eba2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.425443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1025/2016] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:22.426412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096cb89-1d58-416b-b268-7366c9eba2e9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.428164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9096cb89-1d58-416b-b268-7366c9eba2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.440789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65045a-428b-4532-a60b-801ad5f1da66 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.441790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096cb89-1d58-416b-b268-7366c9eba2e9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.446273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.446907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.447185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.447505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.449484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.453942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583af59-56b0-4b9d-a679-aef774dfebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.456055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:22.457037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583af59-56b0-4b9d-a679-aef774dfebcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.457359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583af59-56b0-4b9d-a679-aef774dfebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.458172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583af59-56b0-4b9d-a679-aef774dfebcc admin admin] PATH_INFO: `/v3/projects/7d4aa0517bb44960af6cf206a2345d9d/users/8cdcc96b68bb4fde803b8c9dce327d1c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.498507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583af59-56b0-4b9d-a679-aef774dfebcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4aa0517bb44960af6cf206a2345d9d, user_id=8cdcc96b68bb4fde803b8c9dce327d1c, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.501865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583af59-56b0-4b9d-a679-aef774dfebcc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.519996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1026/2017] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:22 2022] PUT /identity/v3/projects/7d4aa0517bb44960af6cf206a2345d9d/users/8cdcc96b68bb4fde803b8c9dce327d1c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:22.524516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d9973-40b8-4bc2-a477-1dceae186b2f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.524803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d9973-40b8-4bc2-a477-1dceae186b2f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.525154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d9973-40b8-4bc2-a477-1dceae186b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.550466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-df9d9973-40b8-4bc2-a477-1dceae186b2f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:22.551601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-df9d9973-40b8-4bc2-a477-1dceae186b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.585430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.586675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.600040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 992/2018] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:22.601870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.616742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38985-2d79-4ff5-bbeb-59aec5160b39 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.680560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1027/2019] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:22.681765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d9973-40b8-4bc2-a477-1dceae186b2f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.688084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-df9d9973-40b8-4bc2-a477-1dceae186b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.704959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d9973-40b8-4bc2-a477-1dceae186b2f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.712810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.713968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.714080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8a8d6-773c-4aec-938f-67c555d0ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.714545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.714911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a8d6-773c-4aec-938f-67c555d0ce11 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.715219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] PATH_INFO: `/v3/projects/137fcb4249254a099c146a9f9d2ca3f7` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.715323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a8d6-773c-4aec-938f-67c555d0ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.715749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8a8d6-773c-4aec-938f-67c555d0ce11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.716425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8a8d6-773c-4aec-938f-67c555d0ce11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.717253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137fcb4249254a099c146a9f9d2ca3f7)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.718435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8a8d6-773c-4aec-938f-67c555d0ce11 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.719462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.734434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 993/2020] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:22.734434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8a8d6-773c-4aec-938f-67c555d0ce11 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.751285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8a8d6-773c-4aec-938f-67c555d0ce11 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.753394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:22.757935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.758752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.759271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.759842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.760835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:22.761350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.763017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.776857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 994/2021] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:22.777751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.805611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e76f3-43f2-4611-8fff-1bf8ddca9a0d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.808578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137fcb4249254a099c146a9f9d2ca3f7', 'request_id': 'req-c7bb67de-f334-45c2-a65f-11b7a868d873'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.818553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137fcb4249254a099c146a9f9d2ca3f7', 'request_id': 'req-c7bb67de-f334-45c2-a65f-11b7a868d873'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.838374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137fcb4249254a099c146a9f9d2ca3f7', 'request_id': 'req-c7bb67de-f334-45c2-a65f-11b7a868d873'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.856015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] The token cache is being invalidate because project 137fcb4249254a099c146a9f9d2ca3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:22.856315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.857007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:22.858903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1028/2022] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:22 2022] DELETE /identity/v3/projects/137fcb4249254a099c146a9f9d2ca3f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:22.860266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.861646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.880208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.880905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.881277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.881551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] PATH_INFO: `/v3/projects/7d4aa0517bb44960af6cf206a2345d9d/users/8cdcc96b68bb4fde803b8c9dce327d1c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.883499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4aa0517bb44960af6cf206a2345d9d, user_id=8cdcc96b68bb4fde803b8c9dce327d1c, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:22.887141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:22.907358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 995/2023] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:22 2022] PUT /identity/v3/projects/7d4aa0517bb44960af6cf206a2345d9d/users/8cdcc96b68bb4fde803b8c9dce327d1c/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:22.908907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:22.919164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:22.938708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb67de-f334-45c2-a65f-11b7a868d873 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:22.949507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:22.996218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db930ef-b1b4-49d6-9f95-5604cac9b9c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:22.996836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db930ef-b1b4-49d6-9f95-5604cac9b9c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:22.997154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db930ef-b1b4-49d6-9f95-5604cac9b9c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:22.997434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db930ef-b1b4-49d6-9f95-5604cac9b9c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:22.999251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9db930ef-b1b4-49d6-9f95-5604cac9b9c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:23.010633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b4b82-ae2b-4b1d-8935-51e1289a0d8a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.017341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49d46-3354-4146-8534-7681b2300944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.018030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49d46-3354-4146-8534-7681b2300944 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.018324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49d46-3354-4146-8534-7681b2300944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.018601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49d46-3354-4146-8534-7681b2300944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.021146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c49d46-3354-4146-8534-7681b2300944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.023594 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c49d46-3354-4146-8534-7681b2300944 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.057644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 996/2024] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:22 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:23.062462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4ba72-16a0-462f-a16f-e3bc476900db None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.062462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4ba72-16a0-462f-a16f-e3bc476900db None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.062709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4ba72-16a0-462f-a16f-e3bc476900db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.073914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db930ef-b1b4-49d6-9f95-5604cac9b9c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.075449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db930ef-b1b4-49d6-9f95-5604cac9b9c2 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.085424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2eb4ba72-16a0-462f-a16f-e3bc476900db None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:23.085949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1029/2025] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:23.086762 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2eb4ba72-16a0-462f-a16f-e3bc476900db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:23.087573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1659f-bf81-4146-9c6b-e677f3f8edef None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.087775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1659f-bf81-4146-9c6b-e677f3f8edef None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.088083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1659f-bf81-4146-9c6b-e677f3f8edef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.119195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:23.124642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6cb1659f-bf81-4146-9c6b-e677f3f8edef None None] MFA Rules not processed for user `8cdcc96b68bb4fde803b8c9dce327d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:23.125980 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6cb1659f-bf81-4146-9c6b-e677f3f8edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:23.159144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 997/2026] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:23.160043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4ba72-16a0-462f-a16f-e3bc476900db None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.170012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4ba72-16a0-462f-a16f-e3bc476900db None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.175322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1cc42-eee7-40c5-bbf4-9ff573251428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.177136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1cc42-eee7-40c5-bbf4-9ff573251428 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.177424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1cc42-eee7-40c5-bbf4-9ff573251428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.177692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1cc42-eee7-40c5-bbf4-9ff573251428 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.178325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1cc42-eee7-40c5-bbf4-9ff573251428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.180218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1cc42-eee7-40c5-bbf4-9ff573251428 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.203190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 998/2027] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:23 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:23.204439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d0d1-6c47-489e-b1b9-73cc93eb76d2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.204728 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d0d1-6c47-489e-b1b9-73cc93eb76d2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.205025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49d0d1-6c47-489e-b1b9-73cc93eb76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.207657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1030/2028] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:23.209410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1659f-bf81-4146-9c6b-e677f3f8edef None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.228311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1659f-bf81-4146-9c6b-e677f3f8edef None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.233232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bd49d0d1-6c47-489e-b1b9-73cc93eb76d2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:23.234620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bd49d0d1-6c47-489e-b1b9-73cc93eb76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:23.240658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d331-ea1c-46a9-8063-feeac87580ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.241432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d331-ea1c-46a9-8063-feeac87580ea admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.241885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d331-ea1c-46a9-8063-feeac87580ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.242870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5d331-ea1c-46a9-8063-feeac87580ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.243978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5d331-ea1c-46a9-8063-feeac87580ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.245851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5d331-ea1c-46a9-8063-feeac87580ea admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.249200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 999/2029] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:23.249200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49d0d1-6c47-489e-b1b9-73cc93eb76d2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.249200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bd49d0d1-6c47-489e-b1b9-73cc93eb76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:23.261098 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1031/2030] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:23.261982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d331-ea1c-46a9-8063-feeac87580ea admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.274119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5d331-ea1c-46a9-8063-feeac87580ea admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.278830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.279417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.279693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.279958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.280823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:23.281200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.282885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.295989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1032/2031] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:23.297352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.308806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ce320-7276-43f9-8f8c-8a725a8f01c6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.314719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4a692-3617-4e4f-a52b-4bb0e6c2c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.315490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a692-3617-4e4f-a52b-4bb0e6c2c8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.315702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a692-3617-4e4f-a52b-4bb0e6c2c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.315977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a692-3617-4e4f-a52b-4bb0e6c2c8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.316627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4a692-3617-4e4f-a52b-4bb0e6c2c8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.318777 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4a692-3617-4e4f-a52b-4bb0e6c2c8f7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.323968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49d0d1-6c47-489e-b1b9-73cc93eb76d2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.327798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4ac0-2fb1-4fc4-b8cc-4674f56e2bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.328417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4ac0-2fb1-4fc4-b8cc-4674f56e2bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.328695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4ac0-2fb1-4fc4-b8cc-4674f56e2bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.328989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d4ac0-2fb1-4fc4-b8cc-4674f56e2bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.330154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1033/2032] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:23.330969 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4a692-3617-4e4f-a52b-4bb0e6c2c8f7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.341788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4a692-3617-4e4f-a52b-4bb0e6c2c8f7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.342469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4ac0-2fb1-4fc4-b8cc-4674f56e2bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.343989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d4ac0-2fb1-4fc4-b8cc-4674f56e2bc3 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.346848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6c7bb-3694-44fc-98fe-5d384767155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.347525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c7bb-3694-44fc-98fe-5d384767155a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.347955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c7bb-3694-44fc-98fe-5d384767155a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.348067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6c7bb-3694-44fc-98fe-5d384767155a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.349427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6c7bb-3694-44fc-98fe-5d384767155a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.351327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6c7bb-3694-44fc-98fe-5d384767155a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.355185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1000/2033] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:23.356021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4ac0-2fb1-4fc4-b8cc-4674f56e2bc3 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.367025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d4ac0-2fb1-4fc4-b8cc-4674f56e2bc3 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.372054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd143e-7a81-4722-9f59-7d451c86e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.372714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd143e-7a81-4722-9f59-7d451c86e8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.373198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd143e-7a81-4722-9f59-7d451c86e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.373473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd143e-7a81-4722-9f59-7d451c86e8a6 admin admin] PATH_INFO: `/v3/projects/8efb9b2ac3e8418886ed7731a50d3f8c/users/fade489d3ba84032814e10c9e51777b9/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.402013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1034/2034] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:23 2022] POST /identity/v3/projects => generated 407 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:23.403798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd143e-7a81-4722-9f59-7d451c86e8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efb9b2ac3e8418886ed7731a50d3f8c, user_id=fade489d3ba84032814e10c9e51777b9, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.406724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6c7bb-3694-44fc-98fe-5d384767155a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.409094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd143e-7a81-4722-9f59-7d451c86e8a6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.431778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:23.438994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1001/2035] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:23 2022] PUT /identity/v3/projects/8efb9b2ac3e8418886ed7731a50d3f8c/users/fade489d3ba84032814e10c9e51777b9/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:23.452844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047e061-dc98-4b6d-bfda-f6cef0a36033 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.453184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047e061-dc98-4b6d-bfda-f6cef0a36033 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.453468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047e061-dc98-4b6d-bfda-f6cef0a36033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.530760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b047e061-dc98-4b6d-bfda-f6cef0a36033 None None] MFA Rules not processed for user `fade489d3ba84032814e10c9e51777b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:23.532037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b047e061-dc98-4b6d-bfda-f6cef0a36033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:23.532896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6c7bb-3694-44fc-98fe-5d384767155a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.645114 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:23.674865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c0c1b-fb64-4709-93e1-dcc8047e2949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.676906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c0c1b-fb64-4709-93e1-dcc8047e2949 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.677302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c0c1b-fb64-4709-93e1-dcc8047e2949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.677654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c0c1b-fb64-4709-93e1-dcc8047e2949 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.678525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c0c1b-fb64-4709-93e1-dcc8047e2949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.682022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c0c1b-fb64-4709-93e1-dcc8047e2949 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.692598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1002/2036] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:23.705472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047e061-dc98-4b6d-bfda-f6cef0a36033 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.721569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1035/2037] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:23 2022] POST /identity/v3/users => generated 304 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:23.725999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c0c1b-fb64-4709-93e1-dcc8047e2949 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.743438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c0c1b-fb64-4709-93e1-dcc8047e2949 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.761839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1fc7-04c0-4bab-b29a-3aa39175da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.763893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1fc7-04c0-4bab-b29a-3aa39175da20 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.763893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1fc7-04c0-4bab-b29a-3aa39175da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.763893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1fc7-04c0-4bab-b29a-3aa39175da20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.763893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc1fc7-04c0-4bab-b29a-3aa39175da20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.765491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc1fc7-04c0-4bab-b29a-3aa39175da20 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.779462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1036/2038] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:23.783892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1fc7-04c0-4bab-b29a-3aa39175da20 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.796835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1fc7-04c0-4bab-b29a-3aa39175da20 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.802840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1128ae-070e-4021-95a7-1d177f48c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.802987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047e061-dc98-4b6d-bfda-f6cef0a36033 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.803555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1128ae-070e-4021-95a7-1d177f48c101 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.803832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1128ae-070e-4021-95a7-1d177f48c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.804105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1128ae-070e-4021-95a7-1d177f48c101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.805090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1128ae-070e-4021-95a7-1d177f48c101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.807020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1128ae-070e-4021-95a7-1d177f48c101 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.822648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1037/2039] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:23.823654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcada4-1f94-4ba5-8c8a-39468e6136bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.824602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcada4-1f94-4ba5-8c8a-39468e6136bc service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.824919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcada4-1f94-4ba5-8c8a-39468e6136bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.825237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcada4-1f94-4ba5-8c8a-39468e6136bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.827691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1128ae-070e-4021-95a7-1d177f48c101 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:23.840852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1128ae-070e-4021-95a7-1d177f48c101 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:23.842643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcada4-1f94-4ba5-8c8a-39468e6136bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.844098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcada4-1f94-4ba5-8c8a-39468e6136bc service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.849874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:23.849874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.849874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.849874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] PATH_INFO: `/v3/projects/ef0c2a8cab0742139fcf7d1da6a0a627/users/1843fd20162f4ea5a085ac4920bd309f/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.866397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1003/2040] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:23.872849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0c2a8cab0742139fcf7d1da6a0a627, user_id=1843fd20162f4ea5a085ac4920bd309f, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:23.876852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:23.921951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1038/2041] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:23 2022] PUT /identity/v3/projects/ef0c2a8cab0742139fcf7d1da6a0a627/users/1843fd20162f4ea5a085ac4920bd309f/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:23.936691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9793-5904-48d2-83d4-6936e4fc4a33 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:23.937065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9793-5904-48d2-83d4-6936e4fc4a33 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:23.937699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9793-5904-48d2-83d4-6936e4fc4a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:23.977180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-35cd9793-5904-48d2-83d4-6936e4fc4a33 None None] MFA Rules not processed for user `1843fd20162f4ea5a085ac4920bd309f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:23.979269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-35cd9793-5904-48d2-83d4-6936e4fc4a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:24.074546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:24.076467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:24.088829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1004/2042] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:24.092353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd9793-5904-48d2-83d4-6936e4fc4a33 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:24.136123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:24.167484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb7d3c-d47c-44bb-ae90-cc5fc9494047 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:24.174785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:24.176149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.176291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.177242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] PATH_INFO: `/v3/users/6f51254a230a41dab942e71193b96b84` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.180134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f51254a230a41dab942e71193b96b84)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:24.181871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:24.214564 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd9793-5904-48d2-83d4-6936e4fc4a33 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:24.222534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:24.223212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.223806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.228389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.229633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:24.231723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:24.277358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f51254a230a41dab942e71193b96b84'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:24.298094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f51254a230a41dab942e71193b96b84'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:24.299162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f51254a230a41dab942e71193b96b84'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:24.321138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1005/2043] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:24 2022] POST /identity/v3/projects => generated 409 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:24.326245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:24.326426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f51254a230a41dab942e71193b96b84'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:24.327871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f6568b-bad9-4a28-b169-9dbdd31cfbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f51254a230a41dab942e71193b96b84'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:24.334183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:24.348849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1039/2044] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:24 2022] DELETE /identity/v3/users/6f51254a230a41dab942e71193b96b84 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:24.354682 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f24852-6c4b-4983-9eb9-075d29d73d82 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.354961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f24852-6c4b-4983-9eb9-075d29d73d82 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.355315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f24852-6c4b-4983-9eb9-075d29d73d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.378872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e4f24852-6c4b-4983-9eb9-075d29d73d82 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:24.380116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e4f24852-6c4b-4983-9eb9-075d29d73d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:24.385555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:24.462520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409f379-07a2-400f-9157-78b0152f9b32 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:24.474642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1040/2045] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:24.487205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f24852-6c4b-4983-9eb9-075d29d73d82 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:24.488722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e4f24852-6c4b-4983-9eb9-075d29d73d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:24.531137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d9bb-6b09-4c24-a179-aeaee1baa6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:24.531866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d9bb-6b09-4c24-a179-aeaee1baa6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.532187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d9bb-6b09-4c24-a179-aeaee1baa6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.532468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89d9bb-6b09-4c24-a179-aeaee1baa6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.533192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89d9bb-6b09-4c24-a179-aeaee1baa6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:24.536481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89d9bb-6b09-4c24-a179-aeaee1baa6a4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:24.558567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f24852-6c4b-4983-9eb9-075d29d73d82 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:24.563324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fde069-fa2a-4d96-b05e-539aad94eb66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:24.564097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde069-fa2a-4d96-b05e-539aad94eb66 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.564487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde069-fa2a-4d96-b05e-539aad94eb66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.564858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde069-fa2a-4d96-b05e-539aad94eb66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.583328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1006/2046] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:24 2022] POST /identity/v3/users => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:24.584159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d9bb-6b09-4c24-a179-aeaee1baa6a4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:24.597217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89d9bb-6b09-4c24-a179-aeaee1baa6a4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:24.599853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fde069-fa2a-4d96-b05e-539aad94eb66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:24.601527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fde069-fa2a-4d96-b05e-539aad94eb66 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:24.603932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4442b1d-d152-4a6c-9737-f57247422537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:24.604893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442b1d-d152-4a6c-9737-f57247422537 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.605513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442b1d-d152-4a6c-9737-f57247422537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.605664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4442b1d-d152-4a6c-9737-f57247422537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.606672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4442b1d-d152-4a6c-9737-f57247422537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:24.608405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4442b1d-d152-4a6c-9737-f57247422537 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:24.614985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1041/2047] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:24.622887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1007/2048] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:24.627446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fde069-fa2a-4d96-b05e-539aad94eb66 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:24.638260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fde069-fa2a-4d96-b05e-539aad94eb66 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:24.644893 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2f311-eaa0-4621-a1a7-04785830e14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:24.646197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f311-eaa0-4621-a1a7-04785830e14d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.646798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f311-eaa0-4621-a1a7-04785830e14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.646798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2f311-eaa0-4621-a1a7-04785830e14d admin admin] PATH_INFO: `/v3/projects/12cf7d585b4a4a50b6c8f71261e147f9/users/b32ebb5c73df4f7bb3557c6b53d34c61/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.663417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2f311-eaa0-4621-a1a7-04785830e14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cf7d585b4a4a50b6c8f71261e147f9, user_id=b32ebb5c73df4f7bb3557c6b53d34c61, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:24.667072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2f311-eaa0-4621-a1a7-04785830e14d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:24.690443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1042/2049] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:24 2022] PUT /identity/v3/projects/12cf7d585b4a4a50b6c8f71261e147f9/users/b32ebb5c73df4f7bb3557c6b53d34c61/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:24.694805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4442b1d-d152-4a6c-9737-f57247422537 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:24.705259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4442b1d-d152-4a6c-9737-f57247422537 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:24.754181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:24.794738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d8ea1-da07-48c1-b7b5-e8153a5e5dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:24.795528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8ea1-da07-48c1-b7b5-e8153a5e5dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.795881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8ea1-da07-48c1-b7b5-e8153a5e5dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.796220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8ea1-da07-48c1-b7b5-e8153a5e5dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.797331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d8ea1-da07-48c1-b7b5-e8153a5e5dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:24.799023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d8ea1-da07-48c1-b7b5-e8153a5e5dbf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:24.811355 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1008/2050] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:24.815373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2f311-eaa0-4621-a1a7-04785830e14d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:24.832050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2f311-eaa0-4621-a1a7-04785830e14d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:24.838712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:24.839726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.839939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.840140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] PATH_INFO: `/v3/projects/12cf7d585b4a4a50b6c8f71261e147f9/users/b32ebb5c73df4f7bb3557c6b53d34c61/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.842401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cf7d585b4a4a50b6c8f71261e147f9, user_id=b32ebb5c73df4f7bb3557c6b53d34c61, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:24.845793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:24.859148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1043/2051] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:24 2022] PUT /identity/v3/projects/12cf7d585b4a4a50b6c8f71261e147f9/users/b32ebb5c73df4f7bb3557c6b53d34c61/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:24.869623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426e44-a5e9-4e5e-98b6-af515b6037e4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:24.869930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426e44-a5e9-4e5e-98b6-af515b6037e4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:24.870272 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426e44-a5e9-4e5e-98b6-af515b6037e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:24.907013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4f426e44-a5e9-4e5e-98b6-af515b6037e4 None None] MFA Rules not processed for user `b32ebb5c73df4f7bb3557c6b53d34c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:24.908733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4f426e44-a5e9-4e5e-98b6-af515b6037e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:25.023734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1009/2052] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:25.069566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:25.071293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:25.160545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a139-c315-4941-8606-4e86c4bcb814 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:25.164370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:25.165013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:25.165324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:25.165604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:25.175453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:25.177162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:25.187247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1044/2053] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:25.497319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426e44-a5e9-4e5e-98b6-af515b6037e4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:25.510124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426e44-a5e9-4e5e-98b6-af515b6037e4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:25.510286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:25.512723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:25.514929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:25.515836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:25.516241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:25.516555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:25.523161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:25.547389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:25.603916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785277-ebd9-405f-b5a4-00074693e19b service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:25.608905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:25.609466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:25.610738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:25.610738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] PATH_INFO: `/v3/projects/0d7cc289236f4a5c811030716b3a8b70` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:25.611224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7cc289236f4a5c811030716b3a8b70)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:25.613553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:25.618333 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:25.620118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:25.633082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1010/2054] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:25 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:25.679813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7cc289236f4a5c811030716b3a8b70', 'request_id': 'req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.686363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7cc289236f4a5c811030716b3a8b70', 'request_id': 'req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.693876 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7cc289236f4a5c811030716b3a8b70', 'request_id': 'req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.708602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] The token cache is being invalidate because project 0d7cc289236f4a5c811030716b3a8b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:25.708902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.709576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.714524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1045/2055] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:25 2022] DELETE /identity/v3/projects/0d7cc289236f4a5c811030716b3a8b70 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:25.715646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:25.728087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714e7e1-00fb-4f50-8efb-c72a507a3538 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:25.795952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:25.798508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:25.822896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:25.850399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:25.851145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:25.851432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:25.851710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] PATH_INFO: `/v3/users/8cdcc96b68bb4fde803b8c9dce327d1c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:25.853661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdcc96b68bb4fde803b8c9dce327d1c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:25.855616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:25.912240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7660a-f8b1-4839-85ad-f9c4cb79d3eb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:25.916519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:25.917083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:25.917501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:25.917782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:25.920502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:25.945226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdcc96b68bb4fde803b8c9dce327d1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.965434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdcc96b68bb4fde803b8c9dce327d1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.966372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdcc96b68bb4fde803b8c9dce327d1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.978017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdcc96b68bb4fde803b8c9dce327d1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.979062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdcc96b68bb4fde803b8c9dce327d1c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:25.999353 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:26.011609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1011/2056] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:25 2022] DELETE /identity/v3/users/8cdcc96b68bb4fde803b8c9dce327d1c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:26.023069 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:26.031236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:26.040095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1046/2057] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:26.499724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:26.501580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:26.597128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:26.599133 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:26.625008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb400a4-920f-4391-ac8a-f0ea3a9db80c service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:26.633541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:26.634199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:26.634455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:26.634813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] PATH_INFO: `/v3/projects/7d4aa0517bb44960af6cf206a2345d9d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:26.637778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4aa0517bb44960af6cf206a2345d9d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:26.638469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bed357-4c84-4017-aacd-388717979339 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:26.639700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:26.645082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:26.646183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:26.646687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:26.647218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] PATH_INFO: `/v3/users/295e762f42f54269bfee69ff67fbf97e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:26.648743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295e762f42f54269bfee69ff67fbf97e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:26.651142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:26.707052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4aa0517bb44960af6cf206a2345d9d', 'request_id': 'req-5d3fef8d-e698-49e6-8b22-cce30e59be00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.711583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295e762f42f54269bfee69ff67fbf97e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.714300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4aa0517bb44960af6cf206a2345d9d', 'request_id': 'req-5d3fef8d-e698-49e6-8b22-cce30e59be00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.722229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4aa0517bb44960af6cf206a2345d9d', 'request_id': 'req-5d3fef8d-e698-49e6-8b22-cce30e59be00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.743643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295e762f42f54269bfee69ff67fbf97e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.745418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295e762f42f54269bfee69ff67fbf97e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.755139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] The token cache is being invalidate because project 7d4aa0517bb44960af6cf206a2345d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:26.755868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.757436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5d3fef8d-e698-49e6-8b22-cce30e59be00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.758219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295e762f42f54269bfee69ff67fbf97e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.758957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8c46b632-36a2-48dc-87a7-1fb76274b142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295e762f42f54269bfee69ff67fbf97e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:26.762282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1047/2058] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:26 2022] DELETE /identity/v3/projects/7d4aa0517bb44960af6cf206a2345d9d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:26.766241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:26.770150 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135cf0-6835-4dfa-8ef5-509af8fa5ae6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:26.770533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135cf0-6835-4dfa-8ef5-509af8fa5ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:26.770924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76135cf0-6835-4dfa-8ef5-509af8fa5ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:26.780960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1012/2059] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:26 2022] DELETE /identity/v3/users/295e762f42f54269bfee69ff67fbf97e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:26.786474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a017-9891-4732-9510-512065946534 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:26.786717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a017-9891-4732-9510-512065946534 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:26.786923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a017-9891-4732-9510-512065946534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:26.799051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-76135cf0-6835-4dfa-8ef5-509af8fa5ae6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:26.800513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-76135cf0-6835-4dfa-8ef5-509af8fa5ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:26.809763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1ff8a017-9891-4732-9510-512065946534 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:26.811082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1ff8a017-9891-4732-9510-512065946534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:26.916196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1048/2060] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:26.927535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c22ba-a317-4821-a265-519501748cdc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:26.927991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c22ba-a317-4821-a265-519501748cdc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:26.928409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c22ba-a317-4821-a265-519501748cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:26.928634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1013/2061] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:26.941270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a017-9891-4732-9510-512065946534 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:26.943888 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1ff8a017-9891-4732-9510-512065946534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:26.965722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-127c22ba-a317-4821-a265-519501748cdc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:26.967259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-127c22ba-a317-4821-a265-519501748cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:26.981504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1049/2062] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:26.983899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c22ba-a317-4821-a265-519501748cdc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:26.995818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c22ba-a317-4821-a265-519501748cdc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.001078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.001809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.002094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.002549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.003210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:27.003520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.006377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.014710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a017-9891-4732-9510-512065946534 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.018619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855261c-100c-4e68-9b6d-aac178a71c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.019244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855261c-100c-4e68-9b6d-aac178a71c22 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.019535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855261c-100c-4e68-9b6d-aac178a71c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.019818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855261c-100c-4e68-9b6d-aac178a71c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.024300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1050/2063] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:27.025623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:27.037763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855261c-100c-4e68-9b6d-aac178a71c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.039458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855261c-100c-4e68-9b6d-aac178a71c22 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.041982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701206a-49fd-48a7-964e-c84d81b422bb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.048255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7ee4-aba7-4ae8-ae9a-bb2b3e8725a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.049025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7ee4-aba7-4ae8-ae9a-bb2b3e8725a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.049386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7ee4-aba7-4ae8-ae9a-bb2b3e8725a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.049748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e7ee4-aba7-4ae8-ae9a-bb2b3e8725a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.050598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e7ee4-aba7-4ae8-ae9a-bb2b3e8725a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.053057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e7ee4-aba7-4ae8-ae9a-bb2b3e8725a2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.053176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1014/2064] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:27.085018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1051/2065] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:27 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:27.088387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855261c-100c-4e68-9b6d-aac178a71c22 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:27.099803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855261c-100c-4e68-9b6d-aac178a71c22 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.186868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fcd06-86f4-41ae-839a-b4b35195428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.187717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fcd06-86f4-41ae-839a-b4b35195428e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.188387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fcd06-86f4-41ae-839a-b4b35195428e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.188387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fcd06-86f4-41ae-839a-b4b35195428e admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.189095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fcd06-86f4-41ae-839a-b4b35195428e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.191651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fcd06-86f4-41ae-839a-b4b35195428e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.217407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1015/2066] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:27 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:27.221440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7ee4-aba7-4ae8-ae9a-bb2b3e8725a2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:27.265832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e7ee4-aba7-4ae8-ae9a-bb2b3e8725a2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.280105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323fbf5-681f-478b-8ed1-701bbc63d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.282297 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323fbf5-681f-478b-8ed1-701bbc63d187 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.282748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323fbf5-681f-478b-8ed1-701bbc63d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.284744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323fbf5-681f-478b-8ed1-701bbc63d187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.285561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323fbf5-681f-478b-8ed1-701bbc63d187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.291812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323fbf5-681f-478b-8ed1-701bbc63d187 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.317022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1052/2067] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:27.323688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fcd06-86f4-41ae-839a-b4b35195428e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:27.338096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fcd06-86f4-41ae-839a-b4b35195428e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.350972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.353487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.353779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.355095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.356849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.359097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.379042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1016/2068] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:27.384093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323fbf5-681f-478b-8ed1-701bbc63d187 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:27.399710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323fbf5-681f-478b-8ed1-701bbc63d187 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.415265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1da2b7-2789-41c3-9842-b8626eb6c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.415952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1da2b7-2789-41c3-9842-b8626eb6c772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.416236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1da2b7-2789-41c3-9842-b8626eb6c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.416685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1da2b7-2789-41c3-9842-b8626eb6c772 admin admin] PATH_INFO: `/v3/projects/1dae4eee791444f5a03c4e739293bd14/users/2e52a7eb847544e9b737ad1fb028e574/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.441618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:27.444832 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:27.467557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1da2b7-2789-41c3-9842-b8626eb6c772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dae4eee791444f5a03c4e739293bd14, user_id=2e52a7eb847544e9b737ad1fb028e574, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.469797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b7d4a-cd1d-4b73-99ea-941bcafc64db admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.471370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1da2b7-2789-41c3-9842-b8626eb6c772 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.487284 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.488198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.488583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.489027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] PATH_INFO: `/v3/projects/a3b1dd5a82f842688aabe0d7dbcb410c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.490621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b1dd5a82f842688aabe0d7dbcb410c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.493019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.506687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1053/2069] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:27 2022] PUT /identity/v3/projects/1dae4eee791444f5a03c4e739293bd14/users/2e52a7eb847544e9b737ad1fb028e574/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:27.517735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74c3e-ef36-420f-802b-bbc10822161d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.518136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74c3e-ef36-420f-802b-bbc10822161d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.518530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74c3e-ef36-420f-802b-bbc10822161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.523635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:27.541320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:27.605245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-86e74c3e-ef36-420f-802b-bbc10822161d None None] MFA Rules not processed for user `2e52a7eb847544e9b737ad1fb028e574`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:27.605783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b1dd5a82f842688aabe0d7dbcb410c', 'request_id': 'req-bff3addd-0982-4aba-96f2-24c1020d02ff'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:27.608018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-86e74c3e-ef36-420f-802b-bbc10822161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:27.612039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b1dd5a82f842688aabe0d7dbcb410c', 'request_id': 'req-bff3addd-0982-4aba-96f2-24c1020d02ff'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:27.623726 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b1dd5a82f842688aabe0d7dbcb410c', 'request_id': 'req-bff3addd-0982-4aba-96f2-24c1020d02ff'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:27.652955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] The token cache is being invalidate because project a3b1dd5a82f842688aabe0d7dbcb410c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:27.654158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:27.655608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:27.659838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1017/2070] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:27 2022] DELETE /identity/v3/projects/a3b1dd5a82f842688aabe0d7dbcb410c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:27.663936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:27.666553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:27.771162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1054/2071] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:27.782571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e74c3e-ef36-420f-802b-bbc10822161d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:27.784966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-86e74c3e-ef36-420f-802b-bbc10822161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:27.799596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3addd-0982-4aba-96f2-24c1020d02ff admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:27.815384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:27.815985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:27.823428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:27.826736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] PATH_INFO: `/v3/users/86d5e756a66f492facfe8fe0368e8130` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:27.827797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d5e756a66f492facfe8fe0368e8130)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:27.830528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:27.941879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d5e756a66f492facfe8fe0368e8130'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:27.979779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d5e756a66f492facfe8fe0368e8130'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:27.980572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d5e756a66f492facfe8fe0368e8130'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.004204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e74c3e-ef36-420f-802b-bbc10822161d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:28.008835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:28.009549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:28.009894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:28.010396 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:28.011033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d5e756a66f492facfe8fe0368e8130'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.011735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d5e756a66f492facfe8fe0368e8130'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.012223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:28.031891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1018/2072] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:27 2022] DELETE /identity/v3/users/86d5e756a66f492facfe8fe0368e8130 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:28.055838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:28.057413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:28.071956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1055/2073] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:28.419959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:28.421643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:28.453556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:28.517264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f19cbf-c22a-4386-bae0-464f7fd90107 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:28.522951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:28.523596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:28.523909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:28.524454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] PATH_INFO: `/v3/projects/3f2aa46a0f544ff6a8c5b8048b47f516` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:28.525408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2aa46a0f544ff6a8c5b8048b47f516)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:28.527322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:28.579838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2aa46a0f544ff6a8c5b8048b47f516', 'request_id': 'req-d44dfb89-0752-4824-aedf-d9cbc7113dd9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.586330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2aa46a0f544ff6a8c5b8048b47f516', 'request_id': 'req-d44dfb89-0752-4824-aedf-d9cbc7113dd9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.592525 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2aa46a0f544ff6a8c5b8048b47f516', 'request_id': 'req-d44dfb89-0752-4824-aedf-d9cbc7113dd9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.607543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] The token cache is being invalidate because project 3f2aa46a0f544ff6a8c5b8048b47f516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:28.607826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.608439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.609958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1019/2074] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:28 2022] DELETE /identity/v3/projects/3f2aa46a0f544ff6a8c5b8048b47f516 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:28.614158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:28.625408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720fdc-3097-40d9-9021-a051b81e9ab8 service glance] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:28.691316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:28.692221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:28.692527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:28.692800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] PATH_INFO: `/v3/users/48aa0645160b4ef79362cbf373da80a3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:28.693941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=48aa0645160b4ef79362cbf373da80a3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:28.696175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:28.720943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:28.747191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48aa0645160b4ef79362cbf373da80a3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.758936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48aa0645160b4ef79362cbf373da80a3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.759598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48aa0645160b4ef79362cbf373da80a3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.766886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48aa0645160b4ef79362cbf373da80a3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.767510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-33eb81cf-0ecf-404b-a905-cf30764f13ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48aa0645160b4ef79362cbf373da80a3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:28.781480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1056/2075] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:28 2022] DELETE /identity/v3/users/48aa0645160b4ef79362cbf373da80a3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:29.088431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:29.092266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:29.124558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dfb89-0752-4824-aedf-d9cbc7113dd9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:29.207902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:29.209480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.209957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.210714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] PATH_INFO: `/v3/projects/6c8c02953b6e47eca74b24130ca6a979` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.213372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8c02953b6e47eca74b24130ca6a979)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:29.215715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:29.331688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:29.336910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8c02953b6e47eca74b24130ca6a979', 'request_id': 'req-f0d48a62-8c90-4198-80ae-73f367a82e65'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:29.355178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8c02953b6e47eca74b24130ca6a979', 'request_id': 'req-f0d48a62-8c90-4198-80ae-73f367a82e65'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:29.367887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8c02953b6e47eca74b24130ca6a979', 'request_id': 'req-f0d48a62-8c90-4198-80ae-73f367a82e65'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:29.387311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] The token cache is being invalidate because project 6c8c02953b6e47eca74b24130ca6a979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:29.387746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:29.388642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0d48a62-8c90-4198-80ae-73f367a82e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:29.390289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1020/2076] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:29 2022] DELETE /identity/v3/projects/6c8c02953b6e47eca74b24130ca6a979 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:29.396369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45329-a4c2-495d-8767-06516dd4d60d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.396754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45329-a4c2-495d-8767-06516dd4d60d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.397137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce45329-a4c2-495d-8767-06516dd4d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.422298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2ce45329-a4c2-495d-8767-06516dd4d60d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:29.423689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2ce45329-a4c2-495d-8767-06516dd4d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:29.528255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1057/2077] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:29.537531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c020b-e803-45fd-823b-60554a949103 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.538053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c020b-e803-45fd-823b-60554a949103 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.538231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c020b-e803-45fd-823b-60554a949103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.560418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a11c020b-e803-45fd-823b-60554a949103 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:29.561664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a11c020b-e803-45fd-823b-60554a949103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:29.569987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1021/2078] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:29.575267 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45329-a4c2-495d-8767-06516dd4d60d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:29.587648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce45329-a4c2-495d-8767-06516dd4d60d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:29.592440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:29.593090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.593374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.593646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.594355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:29.594671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:29.596286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:29.609551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1058/2079] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:29.614907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c020b-e803-45fd-823b-60554a949103 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:29.624754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c020b-e803-45fd-823b-60554a949103 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:29.629757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f76b1-3d9e-4a47-a571-10598e416e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:29.630616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f76b1-3d9e-4a47-a571-10598e416e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.630616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f76b1-3d9e-4a47-a571-10598e416e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.630899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f76b1-3d9e-4a47-a571-10598e416e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.633880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f76b1-3d9e-4a47-a571-10598e416e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:29.633880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f76b1-3d9e-4a47-a571-10598e416e2f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:29.668039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1022/2080] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:29 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:29.670053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:29.680934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec286c1-86a7-4136-8d37-53b4731bae44 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:29.738977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6bda6-7503-42b4-922f-4c4fd797d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:29.740605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bda6-7503-42b4-922f-4c4fd797d8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.740923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bda6-7503-42b4-922f-4c4fd797d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.741247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bda6-7503-42b4-922f-4c4fd797d8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.741921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6bda6-7503-42b4-922f-4c4fd797d8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:29.757201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6bda6-7503-42b4-922f-4c4fd797d8c4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:29.770201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1059/2081] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:29 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:29.771518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f76b1-3d9e-4a47-a571-10598e416e2f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:29.782248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f76b1-3d9e-4a47-a571-10598e416e2f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:29.787433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d621d-2d5b-44c6-88dd-bd9d1154effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:29.788033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d621d-2d5b-44c6-88dd-bd9d1154effc admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.788311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d621d-2d5b-44c6-88dd-bd9d1154effc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.788581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d621d-2d5b-44c6-88dd-bd9d1154effc admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.789281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d621d-2d5b-44c6-88dd-bd9d1154effc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:29.790855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d621d-2d5b-44c6-88dd-bd9d1154effc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:29.800968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1023/2082] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:29.809165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6bda6-7503-42b4-922f-4c4fd797d8c4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:29.819204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6bda6-7503-42b4-922f-4c4fd797d8c4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:29.824031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fd175-aec5-4748-8acb-82c037e4ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:29.824655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd175-aec5-4748-8acb-82c037e4ca35 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.825134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd175-aec5-4748-8acb-82c037e4ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.825428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd175-aec5-4748-8acb-82c037e4ca35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.826077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fd175-aec5-4748-8acb-82c037e4ca35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:29.827858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fd175-aec5-4748-8acb-82c037e4ca35 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:29.839478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1060/2083] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:29.843701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d621d-2d5b-44c6-88dd-bd9d1154effc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:29.854403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d621d-2d5b-44c6-88dd-bd9d1154effc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:29.859106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599c0e-ca1f-4349-a7c4-a08d85a52860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:29.859758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599c0e-ca1f-4349-a7c4-a08d85a52860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.860044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599c0e-ca1f-4349-a7c4-a08d85a52860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.860322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36599c0e-ca1f-4349-a7c4-a08d85a52860 admin admin] PATH_INFO: `/v3/projects/38b3577d2cf54a28bdc4610fe6637bcf/users/4dbc852e4f124841aa0e0d74bff18f2b/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.876172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599c0e-ca1f-4349-a7c4-a08d85a52860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b3577d2cf54a28bdc4610fe6637bcf, user_id=4dbc852e4f124841aa0e0d74bff18f2b, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:29.878917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36599c0e-ca1f-4349-a7c4-a08d85a52860 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:29.891605 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1024/2084] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:29 2022] PUT /identity/v3/projects/38b3577d2cf54a28bdc4610fe6637bcf/users/4dbc852e4f124841aa0e0d74bff18f2b/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:29.904243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e725-9ed6-4f15-a7d7-f4bea3451892 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:29.904532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e725-9ed6-4f15-a7d7-f4bea3451892 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:29.904813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0e725-9ed6-4f15-a7d7-f4bea3451892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:29.913393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:29.934897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-28c0e725-9ed6-4f15-a7d7-f4bea3451892 None None] MFA Rules not processed for user `4dbc852e4f124841aa0e0d74bff18f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:29.936448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-28c0e725-9ed6-4f15-a7d7-f4bea3451892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:30.003772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1061/2085] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:30.008272 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599c0e-ca1f-4349-a7c4-a08d85a52860 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:30.071453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36599c0e-ca1f-4349-a7c4-a08d85a52860 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:30.076650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2a6a6-ae9a-40cb-aa05-b964a676589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:30.077293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2a6a6-ae9a-40cb-aa05-b964a676589a admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.077578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2a6a6-ae9a-40cb-aa05-b964a676589a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.077855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2a6a6-ae9a-40cb-aa05-b964a676589a admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.078519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2a6a6-ae9a-40cb-aa05-b964a676589a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:30.080457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2a6a6-ae9a-40cb-aa05-b964a676589a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:30.108931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1025/2086] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:30 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:30.113177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e725-9ed6-4f15-a7d7-f4bea3451892 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:30.124643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0e725-9ed6-4f15-a7d7-f4bea3451892 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:30.180510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be984d9-637a-44e3-9855-21b58d7c7e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:30.181174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be984d9-637a-44e3-9855-21b58d7c7e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.181449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be984d9-637a-44e3-9855-21b58d7c7e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.181718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be984d9-637a-44e3-9855-21b58d7c7e79 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.182354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be984d9-637a-44e3-9855-21b58d7c7e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:30.184262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be984d9-637a-44e3-9855-21b58d7c7e79 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:30.205942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1062/2087] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:30 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:30.210604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2a6a6-ae9a-40cb-aa05-b964a676589a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:30.221003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2a6a6-ae9a-40cb-aa05-b964a676589a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:30.226364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb1bd-c171-41df-88b5-ef9686a1e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:30.226951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb1bd-c171-41df-88b5-ef9686a1e73f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.227229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb1bd-c171-41df-88b5-ef9686a1e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.227500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfb1bd-c171-41df-88b5-ef9686a1e73f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.228130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfb1bd-c171-41df-88b5-ef9686a1e73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:30.229776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebfb1bd-c171-41df-88b5-ef9686a1e73f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:30.245349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1026/2088] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:30.246475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be984d9-637a-44e3-9855-21b58d7c7e79 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:30.258509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be984d9-637a-44e3-9855-21b58d7c7e79 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:30.263519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc859774-81bc-4906-a706-bf5f2d16cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:30.264238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc859774-81bc-4906-a706-bf5f2d16cd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.264522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc859774-81bc-4906-a706-bf5f2d16cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.264792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc859774-81bc-4906-a706-bf5f2d16cd34 admin admin] PATH_INFO: `/v3/projects/8a2265fa9389455b8f12e9623fb57bfe/users/5a4cb5718a2044ecb67bce75979a0f27/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.281755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc859774-81bc-4906-a706-bf5f2d16cd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2265fa9389455b8f12e9623fb57bfe, user_id=5a4cb5718a2044ecb67bce75979a0f27, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:30.284424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc859774-81bc-4906-a706-bf5f2d16cd34 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:30.298522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1063/2089] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:30 2022] PUT /identity/v3/projects/8a2265fa9389455b8f12e9623fb57bfe/users/5a4cb5718a2044ecb67bce75979a0f27/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:30.302892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb1bd-c171-41df-88b5-ef9686a1e73f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:30.322373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfb1bd-c171-41df-88b5-ef9686a1e73f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:30.375439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:30.397984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1fdbe-efef-4f1b-aafe-f9551e78cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:30.398702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fdbe-efef-4f1b-aafe-f9551e78cc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.399698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fdbe-efef-4f1b-aafe-f9551e78cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.400223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1fdbe-efef-4f1b-aafe-f9551e78cc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.402045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1fdbe-efef-4f1b-aafe-f9551e78cc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:30.404145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1fdbe-efef-4f1b-aafe-f9551e78cc03 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:30.418410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1027/2090] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:30.424820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc859774-81bc-4906-a706-bf5f2d16cd34 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:30.438689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc859774-81bc-4906-a706-bf5f2d16cd34 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:30.444653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:30.445371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.445652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.445933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] PATH_INFO: `/v3/projects/8a2265fa9389455b8f12e9623fb57bfe/users/5a4cb5718a2044ecb67bce75979a0f27/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.447853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2265fa9389455b8f12e9623fb57bfe, user_id=5a4cb5718a2044ecb67bce75979a0f27, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:30.450611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:30.463991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1064/2091] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:30 2022] PUT /identity/v3/projects/8a2265fa9389455b8f12e9623fb57bfe/users/5a4cb5718a2044ecb67bce75979a0f27/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:30.474690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c2241-716d-4088-829d-b51dd3789fdb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.475768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c2241-716d-4088-829d-b51dd3789fdb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.475768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c2241-716d-4088-829d-b51dd3789fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.511311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-190c2241-716d-4088-829d-b51dd3789fdb None None] MFA Rules not processed for user `5a4cb5718a2044ecb67bce75979a0f27`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:30.512818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-190c2241-716d-4088-829d-b51dd3789fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:30.620391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1028/2092] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:30.635317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:30.638820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:30.720867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:30.728300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0c8b8-343e-462d-bbe0-dc0722caee4a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:30.734416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0867e-b756-427d-9e4e-26aa0d7f06fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:30.735452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0867e-b756-427d-9e4e-26aa0d7f06fd service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.735802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0867e-b756-427d-9e4e-26aa0d7f06fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.736167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0867e-b756-427d-9e4e-26aa0d7f06fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.754526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0867e-b756-427d-9e4e-26aa0d7f06fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:30.756127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0867e-b756-427d-9e4e-26aa0d7f06fd service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:30.770326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1065/2093] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:30.771251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c2241-716d-4088-829d-b51dd3789fdb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:30.772681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-190c2241-716d-4088-829d-b51dd3789fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:30.883584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c2241-716d-4088-829d-b51dd3789fdb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:30.889668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:30.890439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:30.890724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:30.891004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] PATH_INFO: `/v3/users/fade489d3ba84032814e10c9e51777b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:30.892270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fade489d3ba84032814e10c9e51777b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:30.894610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:30.953383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fade489d3ba84032814e10c9e51777b9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:30.969317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fade489d3ba84032814e10c9e51777b9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:30.970251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fade489d3ba84032814e10c9e51777b9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:30.974609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:30.983813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fade489d3ba84032814e10c9e51777b9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:30.986292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fade489d3ba84032814e10c9e51777b9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.001337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1029/2094] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:30 2022] DELETE /identity/v3/users/fade489d3ba84032814e10c9e51777b9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:31.006072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846cee-3007-4c58-b7d6-f5f47be4a610 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:31.006681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846cee-3007-4c58-b7d6-f5f47be4a610 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:31.006972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846cee-3007-4c58-b7d6-f5f47be4a610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:31.027229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-25846cee-3007-4c58-b7d6-f5f47be4a610 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:31.028447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-25846cee-3007-4c58-b7d6-f5f47be4a610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:31.104504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1066/2095] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:31.114626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:31.116016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:31.190353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf3df-b0f3-4d1e-b624-e839eb7c253a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:31.194933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:31.195552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:31.195839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:31.196116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:31.207520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:31.210147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:31.222695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1030/2096] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:31.603804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846cee-3007-4c58-b7d6-f5f47be4a610 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:31.605272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-25846cee-3007-4c58-b7d6-f5f47be4a610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:31.623296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846cee-3007-4c58-b7d6-f5f47be4a610 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:31.633961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:31.635197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:31.635817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:31.636301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] PATH_INFO: `/v3/users/4dbc852e4f124841aa0e0d74bff18f2b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:31.637772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbc852e4f124841aa0e0d74bff18f2b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:31.640224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:31.700882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:31.704207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:31.733238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991990d4-d595-4d3b-bed9-8baf89add089 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:31.738549 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:31.739862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:31.740226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:31.740507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] PATH_INFO: `/v3/projects/8efb9b2ac3e8418886ed7731a50d3f8c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:31.741675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efb9b2ac3e8418886ed7731a50d3f8c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:31.744281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:31.757845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbc852e4f124841aa0e0d74bff18f2b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.778820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbc852e4f124841aa0e0d74bff18f2b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.779523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbc852e4f124841aa0e0d74bff18f2b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.797544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbc852e4f124841aa0e0d74bff18f2b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.798186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fccfed3-a7d6-4ab6-a3d4-a9ac7577118b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbc852e4f124841aa0e0d74bff18f2b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.834129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efb9b2ac3e8418886ed7731a50d3f8c', 'request_id': 'req-fb8b5c1c-f74f-402f-b736-14080287ab30'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.854447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efb9b2ac3e8418886ed7731a50d3f8c', 'request_id': 'req-fb8b5c1c-f74f-402f-b736-14080287ab30'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.862029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1067/2097] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:31 2022] DELETE /identity/v3/users/4dbc852e4f124841aa0e0d74bff18f2b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:31.867065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890e31f-7558-4be1-b0f8-2e66be88a392 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:31.867269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890e31f-7558-4be1-b0f8-2e66be88a392 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:31.867552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890e31f-7558-4be1-b0f8-2e66be88a392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:31.867663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efb9b2ac3e8418886ed7731a50d3f8c', 'request_id': 'req-fb8b5c1c-f74f-402f-b736-14080287ab30'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.904176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9890e31f-7558-4be1-b0f8-2e66be88a392 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:31.905628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9890e31f-7558-4be1-b0f8-2e66be88a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:31.913187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] The token cache is being invalidate because project 8efb9b2ac3e8418886ed7731a50d3f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:31.914742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.914859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fb8b5c1c-f74f-402f-b736-14080287ab30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:31.924074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1031/2098] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:31 2022] DELETE /identity/v3/projects/8efb9b2ac3e8418886ed7731a50d3f8c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:31.928305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034a5e-9638-4c51-a2ea-830f02134d28 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:31.928596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034a5e-9638-4c51-a2ea-830f02134d28 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:31.929129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034a5e-9638-4c51-a2ea-830f02134d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:31.962175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c2034a5e-9638-4c51-a2ea-830f02134d28 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:31.963354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c2034a5e-9638-4c51-a2ea-830f02134d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.021840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1068/2099] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:32.026413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890e31f-7558-4be1-b0f8-2e66be88a392 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.027871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9890e31f-7558-4be1-b0f8-2e66be88a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.035473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:32.045385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890e31f-7558-4be1-b0f8-2e66be88a392 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.058966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.059526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.059809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.060083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] PATH_INFO: `/v3/users/1843fd20162f4ea5a085ac4920bd309f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.061268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1843fd20162f4ea5a085ac4920bd309f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.063198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.081544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1032/2100] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:32.082750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034a5e-9638-4c51-a2ea-830f02134d28 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.090795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c2034a5e-9638-4c51-a2ea-830f02134d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.109373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:32.127594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1843fd20162f4ea5a085ac4920bd309f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.144632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1843fd20162f4ea5a085ac4920bd309f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.146812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1843fd20162f4ea5a085ac4920bd309f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.156073 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1843fd20162f4ea5a085ac4920bd309f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.156809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2169f61-b3a0-4090-9a25-b16bdf511d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1843fd20162f4ea5a085ac4920bd309f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.169547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034a5e-9638-4c51-a2ea-830f02134d28 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.176834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e6907-6c53-43ac-a282-2139f81cf2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.176834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6907-6c53-43ac-a282-2139f81cf2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.176834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6907-6c53-43ac-a282-2139f81cf2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.176834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e6907-6c53-43ac-a282-2139f81cf2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.177292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c40e6907-6c53-43ac-a282-2139f81cf2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.186840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1069/2101] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:32 2022] DELETE /identity/v3/users/1843fd20162f4ea5a085ac4920bd309f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:32.188303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52915bd-76a5-4f92-aea9-ae6ccf0f0142 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.188800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52915bd-76a5-4f92-aea9-ae6ccf0f0142 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.189125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52915bd-76a5-4f92-aea9-ae6ccf0f0142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.193909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e6907-6c53-43ac-a282-2139f81cf2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.195737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e6907-6c53-43ac-a282-2139f81cf2c8 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.207163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1033/2102] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:32.208998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9e3c-6740-4d37-a680-e240e48d659d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.209291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9e3c-6740-4d37-a680-e240e48d659d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.209562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c9e3c-6740-4d37-a680-e240e48d659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.216014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b52915bd-76a5-4f92-aea9-ae6ccf0f0142 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:32.217490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b52915bd-76a5-4f92-aea9-ae6ccf0f0142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.234532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-da4c9e3c-6740-4d37-a680-e240e48d659d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:32.235751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-da4c9e3c-6740-4d37-a680-e240e48d659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.309218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1070/2103] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:32.313322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1034/2104] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:32.313739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52915bd-76a5-4f92-aea9-ae6ccf0f0142 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.323382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52915bd-76a5-4f92-aea9-ae6ccf0f0142 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.328421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c9e3c-6740-4d37-a680-e240e48d659d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.328739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.329480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.329799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.330078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-da4c9e3c-6740-4d37-a680-e240e48d659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.330239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.330917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:32.331281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.332872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.346468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1071/2105] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:00:32.354424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.367037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6d5f-1dac-4693-b5d6-8a65a6d2aaf5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.374071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1715c56-00b3-48cc-b0b2-6f31be83c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.374683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c56-00b3-48cc-b0b2-6f31be83c89d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.374968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c56-00b3-48cc-b0b2-6f31be83c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.375249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c56-00b3-48cc-b0b2-6f31be83c89d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.375892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1715c56-00b3-48cc-b0b2-6f31be83c89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.378084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1715c56-00b3-48cc-b0b2-6f31be83c89d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.417760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c9e3c-6740-4d37-a680-e240e48d659d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.423754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.424247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1072/2106] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:32 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:32.425085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.425546 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.426329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.428612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1715c56-00b3-48cc-b0b2-6f31be83c89d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.438055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.439824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.450688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1035/2107] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:32.491245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:32.521261 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1715c56-00b3-48cc-b0b2-6f31be83c89d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.529129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9073530-260a-4ab2-8ea9-5bea75a470f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.530463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9073530-260a-4ab2-8ea9-5bea75a470f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.530976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9073530-260a-4ab2-8ea9-5bea75a470f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.531262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9073530-260a-4ab2-8ea9-5bea75a470f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.533027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9073530-260a-4ab2-8ea9-5bea75a470f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.537998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9073530-260a-4ab2-8ea9-5bea75a470f5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.556637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.559381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.576681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1073/2108] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:32 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:32.580822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9073530-260a-4ab2-8ea9-5bea75a470f5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.583036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afece91-beb1-480d-9f58-88298f765f6d service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.593420 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.594242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.594632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.595017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] PATH_INFO: `/v3/projects/38b3577d2cf54a28bdc4610fe6637bcf` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.596414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b3577d2cf54a28bdc4610fe6637bcf)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.597525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9073530-260a-4ab2-8ea9-5bea75a470f5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.599192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.603069 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53a2a3-fca1-4050-a0a0-d7b6c6340e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.603589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a2a3-fca1-4050-a0a0-d7b6c6340e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.603873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a2a3-fca1-4050-a0a0-d7b6c6340e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.604148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a2a3-fca1-4050-a0a0-d7b6c6340e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.604896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53a2a3-fca1-4050-a0a0-d7b6c6340e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.607153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53a2a3-fca1-4050-a0a0-d7b6c6340e76 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.625377 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1074/2109] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:32.630612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53a2a3-fca1-4050-a0a0-d7b6c6340e76 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.650835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53a2a3-fca1-4050-a0a0-d7b6c6340e76 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.658545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba028-15c1-462e-a9f1-960b78f59a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.659652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba028-15c1-462e-a9f1-960b78f59a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.660329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba028-15c1-462e-a9f1-960b78f59a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.660834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba028-15c1-462e-a9f1-960b78f59a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.661988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aba028-15c1-462e-a9f1-960b78f59a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.664667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aba028-15c1-462e-a9f1-960b78f59a27 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.696210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1075/2110] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:32.700360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b3577d2cf54a28bdc4610fe6637bcf', 'request_id': 'req-742bc920-fb11-48ff-97f1-dcc67a4d664d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.702483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba028-15c1-462e-a9f1-960b78f59a27 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.703946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:32.714945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b3577d2cf54a28bdc4610fe6637bcf', 'request_id': 'req-742bc920-fb11-48ff-97f1-dcc67a4d664d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.722249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba028-15c1-462e-a9f1-960b78f59a27 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.729181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b3577d2cf54a28bdc4610fe6637bcf', 'request_id': 'req-742bc920-fb11-48ff-97f1-dcc67a4d664d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.758371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] The token cache is being invalidate because project 38b3577d2cf54a28bdc4610fe6637bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:32.760169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.761542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:32.763100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1036/2111] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:32 2022] DELETE /identity/v3/projects/38b3577d2cf54a28bdc4610fe6637bcf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:32.767088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.768900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.822015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.824148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.824933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.825264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] PATH_INFO: `/v3/projects/02d03d2adb4642d9927944330d9c162a/users/19643cb7ee7e43b7b99addcc60591732/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.849266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d03d2adb4642d9927944330d9c162a, user_id=19643cb7ee7e43b7b99addcc60591732, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.852157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.877040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1076/2112] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:32 2022] PUT /identity/v3/projects/02d03d2adb4642d9927944330d9c162a/users/19643cb7ee7e43b7b99addcc60591732/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:32.877503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc920-fb11-48ff-97f1-dcc67a4d664d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:32.881101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:32.883785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:32.975116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:32.975740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:32.976094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:32.976443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] PATH_INFO: `/v3/users/5a4cb5718a2044ecb67bce75979a0f27` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:32.977635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4cb5718a2044ecb67bce75979a0f27)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:32.980376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:32.998672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49816684-47fc-4085-9622-25273cefd5e1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.004342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.005058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.005895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.006173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] PATH_INFO: `/v3/projects/ef0c2a8cab0742139fcf7d1da6a0a627` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.007325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0c2a8cab0742139fcf7d1da6a0a627)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:33.009306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:33.065180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4cb5718a2044ecb67bce75979a0f27'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.082141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4cb5718a2044ecb67bce75979a0f27'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.082905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4cb5718a2044ecb67bce75979a0f27'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.084398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:33.093006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4cb5718a2044ecb67bce75979a0f27'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.093707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ddc95896-677a-4046-be87-f0bbca7ab832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4cb5718a2044ecb67bce75979a0f27'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.101249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0c2a8cab0742139fcf7d1da6a0a627', 'request_id': 'req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.110603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1037/2113] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:32 2022] DELETE /identity/v3/users/5a4cb5718a2044ecb67bce75979a0f27 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:33.110822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0c2a8cab0742139fcf7d1da6a0a627', 'request_id': 'req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.111731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f67c92-d4ef-4467-956d-8ebac35df7e6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.112184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f67c92-d4ef-4467-956d-8ebac35df7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.112466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f67c92-d4ef-4467-956d-8ebac35df7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.120282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0c2a8cab0742139fcf7d1da6a0a627', 'request_id': 'req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.133886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:33.145512 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] The token cache is being invalidate because project ef0c2a8cab0742139fcf7d1da6a0a627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:33.145692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.147048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.148934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1077/2114] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:32 2022] DELETE /identity/v3/projects/ef0c2a8cab0742139fcf7d1da6a0a627 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:33.152659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:33.154359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.173290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d5f67c92-d4ef-4467-956d-8ebac35df7e6 None None] MFA Rules not processed for user `19643cb7ee7e43b7b99addcc60591732`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:33.175804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d5f67c92-d4ef-4467-956d-8ebac35df7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.243502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cefd6-e1c3-451e-8951-6c94e403ad2c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.329873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1038/2115] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:33.334785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f67c92-d4ef-4467-956d-8ebac35df7e6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:33.336581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d5f67c92-d4ef-4467-956d-8ebac35df7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.360711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.361587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.362002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.362507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] PATH_INFO: `/v3/users/b32ebb5c73df4f7bb3557c6b53d34c61` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.363937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32ebb5c73df4f7bb3557c6b53d34c61)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:33.366788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:33.459951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32ebb5c73df4f7bb3557c6b53d34c61'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.479265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32ebb5c73df4f7bb3557c6b53d34c61'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.480513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32ebb5c73df4f7bb3557c6b53d34c61'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.484903 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:33.492285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32ebb5c73df4f7bb3557c6b53d34c61'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.493268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32ebb5c73df4f7bb3557c6b53d34c61'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.499279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f67c92-d4ef-4467-956d-8ebac35df7e6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.507391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.509266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.509772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.510265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.511231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:33.513602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:33.514690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1078/2116] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:33 2022] DELETE /identity/v3/users/b32ebb5c73df4f7bb3557c6b53d34c61 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:33.560385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1039/2117] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:33 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:33.562036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:33.563273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:33.564916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.565266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.659443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309346dd-5adf-467a-8c61-5d62cc7fd5f7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.667893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecd3ca-1c9d-470d-884f-16fa237e200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.667893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecd3ca-1c9d-470d-884f-16fa237e200b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.668242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecd3ca-1c9d-470d-884f-16fa237e200b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.668405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecd3ca-1c9d-470d-884f-16fa237e200b admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.669457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecd3ca-1c9d-470d-884f-16fa237e200b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:33.670536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d43f1-a66a-450b-b154-3f6c6055b550 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.671402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecd3ca-1c9d-470d-884f-16fa237e200b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:33.676119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.676672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.676869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.678092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] PATH_INFO: `/v3/projects/8a2265fa9389455b8f12e9623fb57bfe` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.679306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2265fa9389455b8f12e9623fb57bfe)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:33.681503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:33.703961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1040/2118] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:33 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:33.707867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecd3ca-1c9d-470d-884f-16fa237e200b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:33.720536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecd3ca-1c9d-470d-884f-16fa237e200b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.728187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abb57a-bbea-4a22-9949-babdf0eb14f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.729411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb57a-bbea-4a22-9949-babdf0eb14f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.729887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb57a-bbea-4a22-9949-babdf0eb14f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.730228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb57a-bbea-4a22-9949-babdf0eb14f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.731599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abb57a-bbea-4a22-9949-babdf0eb14f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:33.732776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abb57a-bbea-4a22-9949-babdf0eb14f1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:33.739082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:33.745122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1041/2119] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:33.749523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abb57a-bbea-4a22-9949-babdf0eb14f1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:33.754133 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2265fa9389455b8f12e9623fb57bfe', 'request_id': 'req-cd92d733-b82f-41bd-9c1f-2184dfb9162b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.761285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abb57a-bbea-4a22-9949-babdf0eb14f1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.762393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2265fa9389455b8f12e9623fb57bfe', 'request_id': 'req-cd92d733-b82f-41bd-9c1f-2184dfb9162b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.771392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2265fa9389455b8f12e9623fb57bfe', 'request_id': 'req-cd92d733-b82f-41bd-9c1f-2184dfb9162b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.785001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] The token cache is being invalidate because project 8a2265fa9389455b8f12e9623fb57bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:33.785364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.786021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-cd92d733-b82f-41bd-9c1f-2184dfb9162b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:33.789635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1079/2120] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:33 2022] DELETE /identity/v3/projects/8a2265fa9389455b8f12e9623fb57bfe => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:33.793321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c8dfb-7ae4-40db-b308-52db13270c73 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.793611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c8dfb-7ae4-40db-b308-52db13270c73 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.793896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c8dfb-7ae4-40db-b308-52db13270c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.821097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a13c8dfb-7ae4-40db-b308-52db13270c73 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:33.823136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a13c8dfb-7ae4-40db-b308-52db13270c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.834666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.835428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.835710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.835977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] PATH_INFO: `/v3/projects/380d5a63661542f3a0d7701ae7706c59/users/7e25287eccb644cfb1711fb779fe61c4/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.852713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] RBAC: Authorizing `identity:create_grant(project_id=380d5a63661542f3a0d7701ae7706c59, user_id=7e25287eccb644cfb1711fb779fe61c4, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:33.855659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:33.870083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1042/2121] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:33 2022] PUT /identity/v3/projects/380d5a63661542f3a0d7701ae7706c59/users/7e25287eccb644cfb1711fb779fe61c4/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:33.874228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:33.877846 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.906416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1080/2122] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:33.908013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c8dfb-7ae4-40db-b308-52db13270c73 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:33.909486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a13c8dfb-7ae4-40db-b308-52db13270c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:33.921759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c8dfb-7ae4-40db-b308-52db13270c73 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.936573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:33.964531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951a329-c3af-4be2-b8f1-f32307b7459a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:33.969653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafd07c-f96a-4249-8a5a-945fe2674367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.970283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafd07c-f96a-4249-8a5a-945fe2674367 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.970566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafd07c-f96a-4249-8a5a-945fe2674367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.970868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafd07c-f96a-4249-8a5a-945fe2674367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.971549 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafd07c-f96a-4249-8a5a-945fe2674367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:33.973165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafd07c-f96a-4249-8a5a-945fe2674367 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:33.987358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1043/2123] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:33.987358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33684768-5819-4a2c-b4d0-8a6113bb286b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.987358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33684768-5819-4a2c-b4d0-8a6113bb286b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.987358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33684768-5819-4a2c-b4d0-8a6113bb286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:33.995110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:33.995891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:33.996238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:33.999181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] PATH_INFO: `/v3/projects/12cf7d585b4a4a50b6c8f71261e147f9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.000468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cf7d585b4a4a50b6c8f71261e147f9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.002495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.007750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-33684768-5819-4a2c-b4d0-8a6113bb286b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:34.008950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-33684768-5819-4a2c-b4d0-8a6113bb286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:34.017382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1044/2124] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:34.018282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33684768-5819-4a2c-b4d0-8a6113bb286b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.030927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33684768-5819-4a2c-b4d0-8a6113bb286b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.038192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea482e-9070-4a5e-97c1-44c6b3be229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.039368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea482e-9070-4a5e-97c1-44c6b3be229a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.039657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea482e-9070-4a5e-97c1-44c6b3be229a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.039956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea482e-9070-4a5e-97c1-44c6b3be229a admin admin] PATH_INFO: `/v3/projects/380d5a63661542f3a0d7701ae7706c59/users/7e25287eccb644cfb1711fb779fe61c4/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.043066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea482e-9070-4a5e-97c1-44c6b3be229a admin admin] RBAC: Authorizing `identity:create_grant(project_id=380d5a63661542f3a0d7701ae7706c59, user_id=7e25287eccb644cfb1711fb779fe61c4, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.048393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea482e-9070-4a5e-97c1-44c6b3be229a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.065386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1045/2125] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:34 2022] PUT /identity/v3/projects/380d5a63661542f3a0d7701ae7706c59/users/7e25287eccb644cfb1711fb779fe61c4/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:34.066460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea482e-9070-4a5e-97c1-44c6b3be229a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.076136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cf7d585b4a4a50b6c8f71261e147f9', 'request_id': 'req-d92358fe-3afe-4665-9f45-87f93dd1c709'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:34.088184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cf7d585b4a4a50b6c8f71261e147f9', 'request_id': 'req-d92358fe-3afe-4665-9f45-87f93dd1c709'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:34.101614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cf7d585b4a4a50b6c8f71261e147f9', 'request_id': 'req-d92358fe-3afe-4665-9f45-87f93dd1c709'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:34.134798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] The token cache is being invalidate because project 12cf7d585b4a4a50b6c8f71261e147f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:34.135119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:34.135761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d92358fe-3afe-4665-9f45-87f93dd1c709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:34.137308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1081/2126] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:33 2022] DELETE /identity/v3/projects/12cf7d585b4a4a50b6c8f71261e147f9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:34.138485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bdb23-e675-43da-9e32-ce68e0243de1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.138762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bdb23-e675-43da-9e32-ce68e0243de1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.139028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bdb23-e675-43da-9e32-ce68e0243de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.157709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea482e-9070-4a5e-97c1-44c6b3be229a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.173441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4f768-ec04-4417-b621-f53ebc44c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.173441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4f768-ec04-4417-b621-f53ebc44c95c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.173441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4f768-ec04-4417-b621-f53ebc44c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.173441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4f768-ec04-4417-b621-f53ebc44c95c admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.173786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4f768-ec04-4417-b621-f53ebc44c95c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:34.173786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4f768-ec04-4417-b621-f53ebc44c95c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.173786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4f768-ec04-4417-b621-f53ebc44c95c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.173786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:34.185714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1046/2127] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:34.186987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979073-f774-4c72-8be6-939a3e7b9e10 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.187277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979073-f774-4c72-8be6-939a3e7b9e10 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.187555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979073-f774-4c72-8be6-939a3e7b9e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.192397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cb6bdb23-e675-43da-9e32-ce68e0243de1 None None] MFA Rules not processed for user `7e25287eccb644cfb1711fb779fe61c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:34.193768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cb6bdb23-e675-43da-9e32-ce68e0243de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:34.207193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6d979073-f774-4c72-8be6-939a3e7b9e10 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:34.208450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6d979073-f774-4c72-8be6-939a3e7b9e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:34.219248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1047/2128] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:34.220548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979073-f774-4c72-8be6-939a3e7b9e10 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.221881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6d979073-f774-4c72-8be6-939a3e7b9e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:34.234562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979073-f774-4c72-8be6-939a3e7b9e10 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.240326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ac382-a431-4a7e-999d-c229f48450a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.241247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac382-a431-4a7e-999d-c229f48450a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.241247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac382-a431-4a7e-999d-c229f48450a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.241623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac382-a431-4a7e-999d-c229f48450a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.242093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ac382-a431-4a7e-999d-c229f48450a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.243987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ac382-a431-4a7e-999d-c229f48450a7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.271806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1048/2129] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:34 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:34.272867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1082/2130] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:34.273422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b2bb-124d-4fc0-b83f-37f5e142c527 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.273746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b2bb-124d-4fc0-b83f-37f5e142c527 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.274026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b2bb-124d-4fc0-b83f-37f5e142c527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.285169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bdb23-e675-43da-9e32-ce68e0243de1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.298311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bdb23-e675-43da-9e32-ce68e0243de1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.303743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1e01b2bb-124d-4fc0-b83f-37f5e142c527 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:34.304965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1e01b2bb-124d-4fc0-b83f-37f5e142c527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:34.331214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:34.360996 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4f246-3c6a-4b8b-b1fb-74dce247e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.361699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f246-3c6a-4b8b-b1fb-74dce247e052 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.361945 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f246-3c6a-4b8b-b1fb-74dce247e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.362257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f246-3c6a-4b8b-b1fb-74dce247e052 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.362947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f246-3c6a-4b8b-b1fb-74dce247e052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.365516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4f246-3c6a-4b8b-b1fb-74dce247e052 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.372455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1049/2131] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:34.375091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b2bb-124d-4fc0-b83f-37f5e142c527 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.376873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1e01b2bb-124d-4fc0-b83f-37f5e142c527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:34.388616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1083/2132] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:34 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:34.389484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4f246-3c6a-4b8b-b1fb-74dce247e052 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.399754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4f246-3c6a-4b8b-b1fb-74dce247e052 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.404503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.405365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.405724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.406509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.407342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:34.409736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.412567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.425840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1084/2133] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:34.426484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.436546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb86a2-e35f-4fdb-a673-2499249e8b9c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.441573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31425a2d-b20e-4a69-a163-3d438e7d091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.442178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425a2d-b20e-4a69-a163-3d438e7d091c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.442461 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425a2d-b20e-4a69-a163-3d438e7d091c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.442735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31425a2d-b20e-4a69-a163-3d438e7d091c admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.443383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425a2d-b20e-4a69-a163-3d438e7d091c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.445008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31425a2d-b20e-4a69-a163-3d438e7d091c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.446992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b2bb-124d-4fc0-b83f-37f5e142c527 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.450682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.451281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.451561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.451828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.453751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:34.455070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1085/2134] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:34.455826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31425a2d-b20e-4a69-a163-3d438e7d091c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.468582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31425a2d-b20e-4a69-a163-3d438e7d091c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.473490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6e6f7-0d1d-46c1-a3fd-9494cadb8f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.474648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6e6f7-0d1d-46c1-a3fd-9494cadb8f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.474923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6e6f7-0d1d-46c1-a3fd-9494cadb8f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.475268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6e6f7-0d1d-46c1-a3fd-9494cadb8f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.476005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6e6f7-0d1d-46c1-a3fd-9494cadb8f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.477966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6e6f7-0d1d-46c1-a3fd-9494cadb8f65 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.513904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1086/2135] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:34 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:34.518006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6e6f7-0d1d-46c1-a3fd-9494cadb8f65 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.529839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.531374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.547138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1050/2136] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:34.562637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.593402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312042c-bebd-4451-a1c6-2e30ca68c0ad service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.620454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:34.641669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6e6f7-0d1d-46c1-a3fd-9494cadb8f65 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.649864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d2ea4-6fd7-4842-bf8e-0f113fff5b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.650692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2ea4-6fd7-4842-bf8e-0f113fff5b72 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.651116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2ea4-6fd7-4842-bf8e-0f113fff5b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.652145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2ea4-6fd7-4842-bf8e-0f113fff5b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.653095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d2ea4-6fd7-4842-bf8e-0f113fff5b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.655476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d2ea4-6fd7-4842-bf8e-0f113fff5b72 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.675355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1087/2137] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:34.677233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d2ea4-6fd7-4842-bf8e-0f113fff5b72 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.691341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b40a30-8161-439f-a7f4-864a4a4dd229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.693919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b40a30-8161-439f-a7f4-864a4a4dd229 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.694341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b40a30-8161-439f-a7f4-864a4a4dd229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.695103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b40a30-8161-439f-a7f4-864a4a4dd229 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.698507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b40a30-8161-439f-a7f4-864a4a4dd229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.700426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d2ea4-6fd7-4842-bf8e-0f113fff5b72 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.702753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b40a30-8161-439f-a7f4-864a4a4dd229 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.716802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29334795-7868-4a81-9903-af150376e9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.717650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334795-7868-4a81-9903-af150376e9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.717939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334795-7868-4a81-9903-af150376e9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.718215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334795-7868-4a81-9903-af150376e9c7 admin admin] PATH_INFO: `/v3/projects/ad2865ea5a914dd696e713d6058e0d7d/users/a5e60dd9b2d74548815979a02ba16c3a/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.750922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1051/2138] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:34 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:34.756439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b40a30-8161-439f-a7f4-864a4a4dd229 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.758307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334795-7868-4a81-9903-af150376e9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2865ea5a914dd696e713d6058e0d7d, user_id=a5e60dd9b2d74548815979a02ba16c3a, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.763773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334795-7868-4a81-9903-af150376e9c7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.775348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b40a30-8161-439f-a7f4-864a4a4dd229 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.795830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1088/2139] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:34 2022] PUT /identity/v3/projects/ad2865ea5a914dd696e713d6058e0d7d/users/a5e60dd9b2d74548815979a02ba16c3a/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:34.796035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396fde2-1137-4d2e-9732-a67b6b4d13ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:34.796035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396fde2-1137-4d2e-9732-a67b6b4d13ec admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.796035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396fde2-1137-4d2e-9732-a67b6b4d13ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.796035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396fde2-1137-4d2e-9732-a67b6b4d13ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.796371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396fde2-1137-4d2e-9732-a67b6b4d13ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:34.797646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1c201-db8d-4068-9a6f-08995e3374a8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:34.797933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1c201-db8d-4068-9a6f-08995e3374a8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:34.798054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396fde2-1137-4d2e-9732-a67b6b4d13ec admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:34.798196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1c201-db8d-4068-9a6f-08995e3374a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:34.818955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1052/2140] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:34.825239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396fde2-1137-4d2e-9732-a67b6b4d13ec admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:34.847960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396fde2-1137-4d2e-9732-a67b6b4d13ec admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:34.858270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-33e1c201-db8d-4068-9a6f-08995e3374a8 None None] MFA Rules not processed for user `a5e60dd9b2d74548815979a02ba16c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:34.859755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33e1c201-db8d-4068-9a6f-08995e3374a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:34.932086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:34.985829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1089/2141] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:35.014138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685183a-13ce-48e7-a498-6c822285fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:35.015164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685183a-13ce-48e7-a498-6c822285fe89 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:35.015591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685183a-13ce-48e7-a498-6c822285fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:35.016136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685183a-13ce-48e7-a498-6c822285fe89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:35.016813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685183a-13ce-48e7-a498-6c822285fe89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:35.018448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685183a-13ce-48e7-a498-6c822285fe89 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:35.022811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1c201-db8d-4068-9a6f-08995e3374a8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:35.044153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1053/2142] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:35.050015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685183a-13ce-48e7-a498-6c822285fe89 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:35.072243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685183a-13ce-48e7-a498-6c822285fe89 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:35.081772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907eb25-5ad0-4ea2-8601-be3eea89ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:35.082511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907eb25-5ad0-4ea2-8601-be3eea89ba66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:35.082803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907eb25-5ad0-4ea2-8601-be3eea89ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:35.084651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907eb25-5ad0-4ea2-8601-be3eea89ba66 admin admin] PATH_INFO: `/v3/projects/ebce5b6adca340a0a37d2917c450db36/users/da8a593d5e854501a8f56969d1a7b2cd/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:35.104741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907eb25-5ad0-4ea2-8601-be3eea89ba66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebce5b6adca340a0a37d2917c450db36, user_id=da8a593d5e854501a8f56969d1a7b2cd, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:35.106834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1c201-db8d-4068-9a6f-08995e3374a8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:35.107414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907eb25-5ad0-4ea2-8601-be3eea89ba66 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:35.116034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:35.116705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:35.117130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:35.117527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:35.128243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:35.129247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:35.133396 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1054/2143] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:35 2022] PUT /identity/v3/projects/ebce5b6adca340a0a37d2917c450db36/users/da8a593d5e854501a8f56969d1a7b2cd/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:35.144706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929c80-0863-4ac7-89ff-bb504e3a0f1f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:35.147806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929c80-0863-4ac7-89ff-bb504e3a0f1f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:35.148175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929c80-0863-4ac7-89ff-bb504e3a0f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:35.170324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1090/2144] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:35.182649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-01929c80-0863-4ac7-89ff-bb504e3a0f1f None None] MFA Rules not processed for user `da8a593d5e854501a8f56969d1a7b2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:35.183769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-01929c80-0863-4ac7-89ff-bb504e3a0f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:35.261371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:35.266811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1055/2145] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:35.284227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:35.285968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:35.369808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948585a3-d017-4538-84ea-8225b8107879 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:35.424680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc134e-aba7-4020-bb83-df99f2aba33a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:35.425350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc134e-aba7-4020-bb83-df99f2aba33a service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:35.425627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc134e-aba7-4020-bb83-df99f2aba33a service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:35.425899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc134e-aba7-4020-bb83-df99f2aba33a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:35.437586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc134e-aba7-4020-bb83-df99f2aba33a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:35.439037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc134e-aba7-4020-bb83-df99f2aba33a service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:35.448679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1091/2146] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:37.328318 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929c80-0863-4ac7-89ff-bb504e3a0f1f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:37.330282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-01929c80-0863-4ac7-89ff-bb504e3a0f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:37.423752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929c80-0863-4ac7-89ff-bb504e3a0f1f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:37.428707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:37.429452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:37.429736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:37.430011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] PATH_INFO: `/v3/users/19643cb7ee7e43b7b99addcc60591732` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:37.431152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19643cb7ee7e43b7b99addcc60591732)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:37.433125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:37.491429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19643cb7ee7e43b7b99addcc60591732'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:37.508566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19643cb7ee7e43b7b99addcc60591732'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:37.510054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19643cb7ee7e43b7b99addcc60591732'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:37.522458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19643cb7ee7e43b7b99addcc60591732'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:37.523763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19643cb7ee7e43b7b99addcc60591732'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:37.544439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1056/2147] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:37 2022] DELETE /identity/v3/users/19643cb7ee7e43b7b99addcc60591732 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:37.552002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1814-668e-4599-8752-a96781f2f176 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:37.552002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1814-668e-4599-8752-a96781f2f176 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:37.552002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a1814-668e-4599-8752-a96781f2f176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:37.575014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-794a1814-668e-4599-8752-a96781f2f176 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:37.576212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-794a1814-668e-4599-8752-a96781f2f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:37.627997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:37.694477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1092/2148] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:37.704565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:37.706042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:37.815251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da23c-696c-4b64-956b-4849a77ea32e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:37.830039 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15112ac7-c546-4c3e-af0c-4bc4ba4ab925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:37.832351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112ac7-c546-4c3e-af0c-4bc4ba4ab925 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:37.832808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112ac7-c546-4c3e-af0c-4bc4ba4ab925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:37.834563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112ac7-c546-4c3e-af0c-4bc4ba4ab925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:37.859167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15112ac7-c546-4c3e-af0c-4bc4ba4ab925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:37.860948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15112ac7-c546-4c3e-af0c-4bc4ba4ab925 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:37.878206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1057/2149] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:38.424256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a1814-668e-4599-8752-a96781f2f176 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:38.426776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-794a1814-668e-4599-8752-a96781f2f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:38.457190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a1814-668e-4599-8752-a96781f2f176 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:38.457190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:38.457190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:38.457190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:38.457550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] PATH_INFO: `/v3/projects/02d03d2adb4642d9927944330d9c162a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:38.457550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d03d2adb4642d9927944330d9c162a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:38.457550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:38.526059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d03d2adb4642d9927944330d9c162a', 'request_id': 'req-63936f65-95a1-4fbf-82a6-16160ddc2be6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.534664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d03d2adb4642d9927944330d9c162a', 'request_id': 'req-63936f65-95a1-4fbf-82a6-16160ddc2be6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.544248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d03d2adb4642d9927944330d9c162a', 'request_id': 'req-63936f65-95a1-4fbf-82a6-16160ddc2be6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.562456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] The token cache is being invalidate because project 02d03d2adb4642d9927944330d9c162a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:38.563021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.563544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-63936f65-95a1-4fbf-82a6-16160ddc2be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.565696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1093/2150] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:38 2022] DELETE /identity/v3/projects/02d03d2adb4642d9927944330d9c162a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:38.570570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15112ac7-c546-4c3e-af0c-4bc4ba4ab925 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:38.581232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15112ac7-c546-4c3e-af0c-4bc4ba4ab925 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:38.605779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:38.684007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:38.684729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:38.685216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:38.685503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] PATH_INFO: `/v3/users/7e25287eccb644cfb1711fb779fe61c4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:38.686676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e25287eccb644cfb1711fb779fe61c4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:38.688617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:38.771227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e25287eccb644cfb1711fb779fe61c4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.790900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e25287eccb644cfb1711fb779fe61c4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.791676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e25287eccb644cfb1711fb779fe61c4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.799841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e25287eccb644cfb1711fb779fe61c4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.800620 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5149532e-05b9-4a55-92c2-dcab96d56f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e25287eccb644cfb1711fb779fe61c4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:38.827893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1058/2151] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:38 2022] DELETE /identity/v3/users/7e25287eccb644cfb1711fb779fe61c4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:39.055946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb1c2-191b-4c75-b7dc-40be1191a3de None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.056477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb1c2-191b-4c75-b7dc-40be1191a3de None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.056933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb1c2-191b-4c75-b7dc-40be1191a3de None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.059185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1094/2152] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:00:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:00:39.100452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61ce1-7a1e-48fd-a672-17bdde24e441 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.100452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61ce1-7a1e-48fd-a672-17bdde24e441 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.100808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61ce1-7a1e-48fd-a672-17bdde24e441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.145193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7bd61ce1-7a1e-48fd-a672-17bdde24e441 None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:39.147798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb1c2-191b-4c75-b7dc-40be1191a3de None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:39.149160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7bd61ce1-7a1e-48fd-a672-17bdde24e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.152557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-44beb1c2-191b-4c75-b7dc-40be1191a3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.324709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb1c2-191b-4c75-b7dc-40be1191a3de None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:39.331812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:39.332450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.332741 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.333018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] PATH_INFO: `/v3/users/5d6271f24cdc4a5094c1bb654d524eb3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.334189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6271f24cdc4a5094c1bb654d524eb3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:39.336127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:39.342186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1059/2153] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:39.343231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd61ce1-7a1e-48fd-a672-17bdde24e441 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:39.345674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7bd61ce1-7a1e-48fd-a672-17bdde24e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.362127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd61ce1-7a1e-48fd-a672-17bdde24e441 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:39.369696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:39.370557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.370891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.371174 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] PATH_INFO: `/v3/projects/380d5a63661542f3a0d7701ae7706c59` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.374588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380d5a63661542f3a0d7701ae7706c59)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:39.377900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:39.406471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6271f24cdc4a5094c1bb654d524eb3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.424306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6271f24cdc4a5094c1bb654d524eb3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.425087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6271f24cdc4a5094c1bb654d524eb3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.427278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:39.427919 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:39.438235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6271f24cdc4a5094c1bb654d524eb3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.439763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6271f24cdc4a5094c1bb654d524eb3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.445970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380d5a63661542f3a0d7701ae7706c59', 'request_id': 'req-a777ef83-96b3-4402-9d02-c14ee0b51c57'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.455130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380d5a63661542f3a0d7701ae7706c59', 'request_id': 'req-a777ef83-96b3-4402-9d02-c14ee0b51c57'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.476106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380d5a63661542f3a0d7701ae7706c59', 'request_id': 'req-a777ef83-96b3-4402-9d02-c14ee0b51c57'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.481872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1095/2154] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:39 2022] DELETE /identity/v3/users/5d6271f24cdc4a5094c1bb654d524eb3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:39.482977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:39.486178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.502502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] The token cache is being invalidate because project 380d5a63661542f3a0d7701ae7706c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:39.502793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.504891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a777ef83-96b3-4402-9d02-c14ee0b51c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.507292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1060/2155] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:39 2022] DELETE /identity/v3/projects/380d5a63661542f3a0d7701ae7706c59 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:39.512167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127c5f-7c51-4bce-94db-c910ceaa2678 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.512466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127c5f-7c51-4bce-94db-c910ceaa2678 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.512793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127c5f-7c51-4bce-94db-c910ceaa2678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.573112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f3127c5f-7c51-4bce-94db-c910ceaa2678 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:39.574399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f3127c5f-7c51-4bce-94db-c910ceaa2678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.620752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d991781-dc73-4902-b165-5b289ae6a4d7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:39.635795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:39.636418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.636695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.636967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.640668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.660114 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1061/2156] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:39.676105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:39.677972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:39.678684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded503-e822-483d-9807-02c7aa6a8003 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.679391 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded503-e822-483d-9807-02c7aa6a8003 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.679866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded503-e822-483d-9807-02c7aa6a8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.696180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1096/2157] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:39.714686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-92ded503-e822-483d-9807-02c7aa6a8003 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:39.716467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-92ded503-e822-483d-9807-02c7aa6a8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.729018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1062/2158] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:39.731322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:39.741277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ded503-e822-483d-9807-02c7aa6a8003 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:39.742140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72d61-b9b5-4f7e-800e-b4eb681406d9 service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:39.743226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-92ded503-e822-483d-9807-02c7aa6a8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.747050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:39.748111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.748111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.748413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.749253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:39.749645 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:39.751794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:39.763598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1097/2159] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:39.767892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:39.773541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ded503-e822-483d-9807-02c7aa6a8003 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:39.779077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9434-ecbb-421c-ba32-7a652ac8bfce admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:39.783144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:39.784015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73694ef-1465-4635-900e-0537a21918e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:39.784393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.784672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73694ef-1465-4635-900e-0537a21918e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.784952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73694ef-1465-4635-900e-0537a21918e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.785265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73694ef-1465-4635-900e-0537a21918e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.785540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.785895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73694ef-1465-4635-900e-0537a21918e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:39.786209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] PATH_INFO: `/v3/projects/938258dab1fa48449a751e24b6d8384c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.788408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73694ef-1465-4635-900e-0537a21918e9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:39.788661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=938258dab1fa48449a751e24b6d8384c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:39.790618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:39.828025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1098/2160] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:39 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:39.832354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73694ef-1465-4635-900e-0537a21918e9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:39.859409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938258dab1fa48449a751e24b6d8384c', 'request_id': 'req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.865884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938258dab1fa48449a751e24b6d8384c', 'request_id': 'req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.873687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938258dab1fa48449a751e24b6d8384c', 'request_id': 'req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.892061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] The token cache is being invalidate because project 938258dab1fa48449a751e24b6d8384c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:39.892061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.892061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a0aed45-2de0-4b66-8040-bc1c79edf6ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:39.893200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1063/2161] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:39 2022] DELETE /identity/v3/projects/938258dab1fa48449a751e24b6d8384c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:39.897735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c76fc-97ef-490a-89ec-e8711c01ba32 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.898022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c76fc-97ef-490a-89ec-e8711c01ba32 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.898300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c76fc-97ef-490a-89ec-e8711c01ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.910387 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73694ef-1465-4635-900e-0537a21918e9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:39.919054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7f2c76fc-97ef-490a-89ec-e8711c01ba32 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:39.920249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7f2c76fc-97ef-490a-89ec-e8711c01ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:39.961061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:39.961262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:39.987484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:39.988429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:39.988717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:39.989017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:39.989658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:39.992197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:39.997244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1064/2162] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:40.004498 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf27b-bb31-44be-bbdb-1d33e86dcdb4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.004790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf27b-bb31-44be-bbdb-1d33e86dcdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.005103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf27b-bb31-44be-bbdb-1d33e86dcdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.025420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1099/2163] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:39 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:40.028840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ebdaf27b-bb31-44be-bbdb-1d33e86dcdb4 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:40.029159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ebdaf27b-bb31-44be-bbdb-1d33e86dcdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.030395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.032359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.039316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1065/2164] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:40.043393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf27b-bb31-44be-bbdb-1d33e86dcdb4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.046324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1a220-e454-47e5-b58c-8e37af10495b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.052167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46da0-843c-42eb-86b4-1825acc759ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.053366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46da0-843c-42eb-86b4-1825acc759ee admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.053649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46da0-843c-42eb-86b4-1825acc759ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.053917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46da0-843c-42eb-86b4-1825acc759ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.054556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf46da0-843c-42eb-86b4-1825acc759ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.055749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf27b-bb31-44be-bbdb-1d33e86dcdb4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.056147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf46da0-843c-42eb-86b4-1825acc759ee admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.060750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.061617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.061908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.062519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.062822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:40.063124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.064710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.067094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1100/2165] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:40.071384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46da0-843c-42eb-86b4-1825acc759ee admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.077505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1066/2166] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:00:40.081976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.084800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46da0-843c-42eb-86b4-1825acc759ee admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.091772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75826e5b-2011-4c0d-9118-45ff76ef99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.093761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826e5b-2011-4c0d-9118-45ff76ef99fc admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.094054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826e5b-2011-4c0d-9118-45ff76ef99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.094324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826e5b-2011-4c0d-9118-45ff76ef99fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.094988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75826e5b-2011-4c0d-9118-45ff76ef99fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.096711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75826e5b-2011-4c0d-9118-45ff76ef99fc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.097202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb15a-35ba-4c5e-a93a-a0f3ca308eb3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.103108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8f34d-4d1e-4acf-a58d-cdbeecdfcfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.103722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f34d-4d1e-4acf-a58d-cdbeecdfcfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.104005 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f34d-4d1e-4acf-a58d-cdbeecdfcfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.104283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8f34d-4d1e-4acf-a58d-cdbeecdfcfc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.105268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8f34d-4d1e-4acf-a58d-cdbeecdfcfc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.107278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8f34d-4d1e-4acf-a58d-cdbeecdfcfc9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.108860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1101/2167] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:40.113009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75826e5b-2011-4c0d-9118-45ff76ef99fc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.125021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75826e5b-2011-4c0d-9118-45ff76ef99fc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.130630 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb05753-32da-4aac-93a5-fccb71aa2975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.131360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb05753-32da-4aac-93a5-fccb71aa2975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.131648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb05753-32da-4aac-93a5-fccb71aa2975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.131921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb05753-32da-4aac-93a5-fccb71aa2975 admin admin] PATH_INFO: `/v3/projects/552c7ecb06df4caf869d2c01f331b0b1/users/454cba938ec84f1b924a766ff2a82b52/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.140912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1067/2168] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:40 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:40.145361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8f34d-4d1e-4acf-a58d-cdbeecdfcfc9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.150281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb05753-32da-4aac-93a5-fccb71aa2975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552c7ecb06df4caf869d2c01f331b0b1, user_id=454cba938ec84f1b924a766ff2a82b52, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.153517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb05753-32da-4aac-93a5-fccb71aa2975 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.169457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1102/2169] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:40 2022] PUT /identity/v3/projects/552c7ecb06df4caf869d2c01f331b0b1/users/454cba938ec84f1b924a766ff2a82b52/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:40.181526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110855-1f19-47ae-8bcc-3dbca3863a8d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.181908 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110855-1f19-47ae-8bcc-3dbca3863a8d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.182273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110855-1f19-47ae-8bcc-3dbca3863a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.211577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-46110855-1f19-47ae-8bcc-3dbca3863a8d None None] MFA Rules not processed for user `454cba938ec84f1b924a766ff2a82b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:40.212913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-46110855-1f19-47ae-8bcc-3dbca3863a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.227649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8f34d-4d1e-4acf-a58d-cdbeecdfcfc9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.299154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.300317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.300630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.300903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.301974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.307216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.344131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1103/2170] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:40.344131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110855-1f19-47ae-8bcc-3dbca3863a8d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.344668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-46110855-1f19-47ae-8bcc-3dbca3863a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.359791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1068/2171] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:40 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:40.360806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.362648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.372695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110855-1f19-47ae-8bcc-3dbca3863a8d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.378737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.379593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.379981 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.380355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] PATH_INFO: `/v3/users/099d526f2ae142da9726b931c6bb5f56` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.382170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] RBAC: Authorizing `identity:delete_user(user_id=099d526f2ae142da9726b931c6bb5f56)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.385045 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.405098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:40.436596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308d348-b54f-4ab6-b082-86dc7d3e9604 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.440720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa225bc-d2dc-40cc-83a4-dddaddf36e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.441362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099d526f2ae142da9726b931c6bb5f56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:40.441492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa225bc-d2dc-40cc-83a4-dddaddf36e8d service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.441773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa225bc-d2dc-40cc-83a4-dddaddf36e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.442051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa225bc-d2dc-40cc-83a4-dddaddf36e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.450750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa225bc-d2dc-40cc-83a4-dddaddf36e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.452339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa225bc-d2dc-40cc-83a4-dddaddf36e8d service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.454234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099d526f2ae142da9726b931c6bb5f56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:40.454921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099d526f2ae142da9726b931c6bb5f56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:40.462704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1069/2172] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:40.463474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099d526f2ae142da9726b931c6bb5f56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:40.463645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa225bc-d2dc-40cc-83a4-dddaddf36e8d service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.464285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b8a1d4a-9554-484b-b43c-e45df53c354b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099d526f2ae142da9726b931c6bb5f56'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:40.466020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:40.475872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa225bc-d2dc-40cc-83a4-dddaddf36e8d service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.484341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.484964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.485280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.485559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.486457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.491068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1104/2173] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:40 2022] DELETE /identity/v3/users/099d526f2ae142da9726b931c6bb5f56 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:40.491223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.494559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a1272-1a01-4a07-b237-3744b7ff9e2f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.495283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a1272-1a01-4a07-b237-3744b7ff9e2f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.495795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a1272-1a01-4a07-b237-3744b7ff9e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.500785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1070/2174] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:40.504464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.506334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.520118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d88a1272-1a01-4a07-b237-3744b7ff9e2f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:40.522894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d88a1272-1a01-4a07-b237-3744b7ff9e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.525213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd026bdc-7c3c-4ea6-a606-d0ec115fc3a5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.619961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1105/2175] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:40.623051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f38d7-692b-495b-af36-0771c0909d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.623675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f38d7-692b-495b-af36-0771c0909d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.623959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f38d7-692b-495b-af36-0771c0909d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.624238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f38d7-692b-495b-af36-0771c0909d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.625262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f38d7-692b-495b-af36-0771c0909d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.627083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f38d7-692b-495b-af36-0771c0909d5d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.630542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a1272-1a01-4a07-b237-3744b7ff9e2f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.632539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d88a1272-1a01-4a07-b237-3744b7ff9e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.651489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1071/2176] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:40.652833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f38d7-692b-495b-af36-0771c0909d5d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.675992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f38d7-692b-495b-af36-0771c0909d5d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.686037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7f773-88de-4fb2-8ef3-ff30d2dc5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.686717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7f773-88de-4fb2-8ef3-ff30d2dc5324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.687438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7f773-88de-4fb2-8ef3-ff30d2dc5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.687723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7f773-88de-4fb2-8ef3-ff30d2dc5324 admin admin] PATH_INFO: `/v3/projects/66a0a0d5766e47228f6fdf11f8ec723a/users/549d0ae567994dc5b58f24fbb614363b/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.710044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7f773-88de-4fb2-8ef3-ff30d2dc5324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a0a0d5766e47228f6fdf11f8ec723a, user_id=549d0ae567994dc5b58f24fbb614363b, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.710560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a1272-1a01-4a07-b237-3744b7ff9e2f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.713592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7f773-88de-4fb2-8ef3-ff30d2dc5324 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.715465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.716066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.716348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.716646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.730713 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:40.733041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:40.741894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1072/2177] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:40 2022] PUT /identity/v3/projects/66a0a0d5766e47228f6fdf11f8ec723a/users/549d0ae567994dc5b58f24fbb614363b/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:40.745219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1106/2178] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:40.748387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fb898-a067-43dc-9fdc-2b937be1e15b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.748838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fb898-a067-43dc-9fdc-2b937be1e15b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.749380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fb898-a067-43dc-9fdc-2b937be1e15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:40.774636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8c8fb898-a067-43dc-9fdc-2b937be1e15b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:40.776330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8c8fb898-a067-43dc-9fdc-2b937be1e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.887605 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1073/2179] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:40.919471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:40.921165 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:40.935866 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825dd7c-cae6-41d7-989c-89439a81a995 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:40.993695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d9d2-90dd-4f14-9aa5-08bae1915ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:40.994792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d9d2-90dd-4f14-9aa5-08bae1915ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:40.995062 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d9d2-90dd-4f14-9aa5-08bae1915ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:40.995337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d9d2-90dd-4f14-9aa5-08bae1915ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:41.004991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399d9d2-90dd-4f14-9aa5-08bae1915ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:41.006969 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399d9d2-90dd-4f14-9aa5-08bae1915ed9 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:41.016442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1107/2180] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:41.229593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fb898-a067-43dc-9fdc-2b937be1e15b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:41.231075 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8c8fb898-a067-43dc-9fdc-2b937be1e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:41.245351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fb898-a067-43dc-9fdc-2b937be1e15b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:41.252738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:41.253634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:41.253768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:41.253985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] PATH_INFO: `/v3/projects/4e52cb728d5f4606934872eb17665b81` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:41.255204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e52cb728d5f4606934872eb17665b81)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:41.259095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:41.301864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:41.317958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e52cb728d5f4606934872eb17665b81', 'request_id': 'req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.329288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e52cb728d5f4606934872eb17665b81', 'request_id': 'req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.336449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e52cb728d5f4606934872eb17665b81', 'request_id': 'req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.351966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] The token cache is being invalidate because project 4e52cb728d5f4606934872eb17665b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:41.352307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.352967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.354706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1074/2181] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:41 2022] DELETE /identity/v3/projects/4e52cb728d5f4606934872eb17665b81 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:41.359360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d9d2-90dd-4f14-9aa5-08bae1915ed9 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:41.373840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d9d2-90dd-4f14-9aa5-08bae1915ed9 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:41.429668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:41.464514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:41.465327 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:41.465715 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:41.466089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] PATH_INFO: `/v3/users/afe22bf5aa9442bb9cde661bd7feca2f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:41.468863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe22bf5aa9442bb9cde661bd7feca2f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:41.470847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:41.538409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe22bf5aa9442bb9cde661bd7feca2f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.555958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe22bf5aa9442bb9cde661bd7feca2f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.557118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe22bf5aa9442bb9cde661bd7feca2f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.565514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe22bf5aa9442bb9cde661bd7feca2f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.566238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-42f63523-ac4a-434e-b5e8-8f9a04e061d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe22bf5aa9442bb9cde661bd7feca2f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:41.579208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1108/2182] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:41 2022] DELETE /identity/v3/users/afe22bf5aa9442bb9cde661bd7feca2f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:41.971195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:41.972730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:41.997607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63e5b3-20d0-4af5-a24f-6e1ae335307f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:42.145447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:42.147615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:42.147615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:42.147813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] PATH_INFO: `/v3/projects/cfdb95670c5e43cab2bfbee2ec10e4d7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:42.149601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdb95670c5e43cab2bfbee2ec10e4d7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:42.151971 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:42.296363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdb95670c5e43cab2bfbee2ec10e4d7', 'request_id': 'req-0dc51473-326e-4621-b735-f261da50d103'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:42.319157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdb95670c5e43cab2bfbee2ec10e4d7', 'request_id': 'req-0dc51473-326e-4621-b735-f261da50d103'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:42.346648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdb95670c5e43cab2bfbee2ec10e4d7', 'request_id': 'req-0dc51473-326e-4621-b735-f261da50d103'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:42.381686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] The token cache is being invalidate because project cfdb95670c5e43cab2bfbee2ec10e4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:42.382152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:42.383170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0dc51473-326e-4621-b735-f261da50d103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:42.385190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1075/2183] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:41 2022] DELETE /identity/v3/projects/cfdb95670c5e43cab2bfbee2ec10e4d7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:42.390552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f5ee-a475-4200-b8cc-ed7ab124535f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:42.391043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f5ee-a475-4200-b8cc-ed7ab124535f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:42.391043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4f5ee-a475-4200-b8cc-ed7ab124535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:42.429916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b5e4f5ee-a475-4200-b8cc-ed7ab124535f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:42.431734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b5e4f5ee-a475-4200-b8cc-ed7ab124535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:42.592212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1109/2184] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:42.593377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776569d-27b6-4a48-b033-fccfda4c740f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:42.593773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776569d-27b6-4a48-b033-fccfda4c740f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:42.594060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776569d-27b6-4a48-b033-fccfda4c740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:42.625283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4776569d-27b6-4a48-b033-fccfda4c740f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:42.626737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4776569d-27b6-4a48-b033-fccfda4c740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:42.640347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1076/2185] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:42.645409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4f5ee-a475-4200-b8cc-ed7ab124535f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:42.656668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4f5ee-a475-4200-b8cc-ed7ab124535f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:42.664498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:42.665269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:42.665556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:42.665897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:42.666852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:42.667164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:42.669619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:42.690829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1110/2186] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:42.695065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776569d-27b6-4a48-b033-fccfda4c740f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:42.705837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776569d-27b6-4a48-b033-fccfda4c740f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:42.711429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d9c6c-8627-470b-9900-a935cd0068ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:42.712047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d9c6c-8627-470b-9900-a935cd0068ce admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:42.712992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d9c6c-8627-470b-9900-a935cd0068ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:42.713284 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d9c6c-8627-470b-9900-a935cd0068ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:42.713933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d9c6c-8627-470b-9900-a935cd0068ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:42.726797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d9c6c-8627-470b-9900-a935cd0068ce admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:42.775266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1077/2187] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:42 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:42.779257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:42.792369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8431869-2052-4f4d-998a-748513cede99 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:42.900641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:42.945047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9c456-e187-4cf1-89a6-5f7e02c3da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:42.945745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9c456-e187-4cf1-89a6-5f7e02c3da8d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:42.946093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9c456-e187-4cf1-89a6-5f7e02c3da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:42.946436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9c456-e187-4cf1-89a6-5f7e02c3da8d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:42.947148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9c456-e187-4cf1-89a6-5f7e02c3da8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:42.950413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9c456-e187-4cf1-89a6-5f7e02c3da8d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:42.992037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1111/2188] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:42 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:42.994224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d9c6c-8627-470b-9900-a935cd0068ce admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.012583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d9c6c-8627-470b-9900-a935cd0068ce admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.017701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d468-936d-415e-b5fa-c6a75f713177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.018335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d468-936d-415e-b5fa-c6a75f713177 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.018608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d468-936d-415e-b5fa-c6a75f713177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.018881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d468-936d-415e-b5fa-c6a75f713177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.019701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d468-936d-415e-b5fa-c6a75f713177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.022071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3d468-936d-415e-b5fa-c6a75f713177 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.038204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1078/2189] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:43.041435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9c456-e187-4cf1-89a6-5f7e02c3da8d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.052509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9c456-e187-4cf1-89a6-5f7e02c3da8d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.057380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a261c1-225b-4e8c-b928-420d38060753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.058002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a261c1-225b-4e8c-b928-420d38060753 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.058293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a261c1-225b-4e8c-b928-420d38060753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.058617 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a261c1-225b-4e8c-b928-420d38060753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.059232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a261c1-225b-4e8c-b928-420d38060753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.060821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a261c1-225b-4e8c-b928-420d38060753 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.077713 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1112/2190] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:43.080942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d468-936d-415e-b5fa-c6a75f713177 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.100393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d468-936d-415e-b5fa-c6a75f713177 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.109702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6074022-1654-495d-97e7-bce3c2a82adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.111148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6074022-1654-495d-97e7-bce3c2a82adb admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.111148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6074022-1654-495d-97e7-bce3c2a82adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.111345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6074022-1654-495d-97e7-bce3c2a82adb admin admin] PATH_INFO: `/v3/projects/43828350c50441e3bcf11d631027e9a6/users/44113df263fc4932b30c6bf6e3875713/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.122296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:43.132218 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6074022-1654-495d-97e7-bce3c2a82adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43828350c50441e3bcf11d631027e9a6, user_id=44113df263fc4932b30c6bf6e3875713, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.138013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6074022-1654-495d-97e7-bce3c2a82adb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.168796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1079/2191] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:43 2022] PUT /identity/v3/projects/43828350c50441e3bcf11d631027e9a6/users/44113df263fc4932b30c6bf6e3875713/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:43.169906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710730f1-3876-4572-a3f4-fa4cd2765d78 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.170382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710730f1-3876-4572-a3f4-fa4cd2765d78 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.170739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710730f1-3876-4572-a3f4-fa4cd2765d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.203220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-710730f1-3876-4572-a3f4-fa4cd2765d78 None None] MFA Rules not processed for user `44113df263fc4932b30c6bf6e3875713`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:43.204799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-710730f1-3876-4572-a3f4-fa4cd2765d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:43.281883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1113/2192] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:43.286410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6074022-1654-495d-97e7-bce3c2a82adb admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.353897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6074022-1654-495d-97e7-bce3c2a82adb admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.359372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4982-5f0b-40c6-a360-406340d57cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.360002 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4982-5f0b-40c6-a360-406340d57cdd admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.360283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4982-5f0b-40c6-a360-406340d57cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.360553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4982-5f0b-40c6-a360-406340d57cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.361349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c4982-5f0b-40c6-a360-406340d57cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.363517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c4982-5f0b-40c6-a360-406340d57cdd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.409169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1080/2193] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:43 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:43.412955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710730f1-3876-4572-a3f4-fa4cd2765d78 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.424244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710730f1-3876-4572-a3f4-fa4cd2765d78 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.483221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270704f4-84b9-4125-bbd5-c1fd91de7e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.483932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270704f4-84b9-4125-bbd5-c1fd91de7e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.485896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270704f4-84b9-4125-bbd5-c1fd91de7e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.485896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270704f4-84b9-4125-bbd5-c1fd91de7e9a admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.485896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270704f4-84b9-4125-bbd5-c1fd91de7e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.487161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270704f4-84b9-4125-bbd5-c1fd91de7e9a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.548350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1114/2194] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:43 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:43.548780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4982-5f0b-40c6-a360-406340d57cdd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.565334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4982-5f0b-40c6-a360-406340d57cdd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.573267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a4899-0956-4f1c-a6fc-67d1fe065b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.574061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a4899-0956-4f1c-a6fc-67d1fe065b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.574451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a4899-0956-4f1c-a6fc-67d1fe065b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.574828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a4899-0956-4f1c-a6fc-67d1fe065b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.575804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a4899-0956-4f1c-a6fc-67d1fe065b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.577386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a4899-0956-4f1c-a6fc-67d1fe065b34 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.610335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270704f4-84b9-4125-bbd5-c1fd91de7e9a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.620964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1081/2195] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:43.649532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270704f4-84b9-4125-bbd5-c1fd91de7e9a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.656618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea839a-13aa-4e3c-a61e-a0b73847866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.657364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea839a-13aa-4e3c-a61e-a0b73847866a admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.657649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea839a-13aa-4e3c-a61e-a0b73847866a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.657930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea839a-13aa-4e3c-a61e-a0b73847866a admin admin] PATH_INFO: `/v3/projects/744b1f506976456ea0840f3165c2490f/users/7537d24d9adb4b81b55beaad505bd26a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.685968 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea839a-13aa-4e3c-a61e-a0b73847866a admin admin] RBAC: Authorizing `identity:create_grant(project_id=744b1f506976456ea0840f3165c2490f, user_id=7537d24d9adb4b81b55beaad505bd26a, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.689502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea839a-13aa-4e3c-a61e-a0b73847866a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.709818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1115/2196] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:43 2022] PUT /identity/v3/projects/744b1f506976456ea0840f3165c2490f/users/7537d24d9adb4b81b55beaad505bd26a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:43.715382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a4899-0956-4f1c-a6fc-67d1fe065b34 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.725791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a4899-0956-4f1c-a6fc-67d1fe065b34 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.800067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b7c9d-7144-40c8-9c78-bae118210594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.800716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7c9d-7144-40c8-9c78-bae118210594 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.801158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7c9d-7144-40c8-9c78-bae118210594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.803730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7c9d-7144-40c8-9c78-bae118210594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.804447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b7c9d-7144-40c8-9c78-bae118210594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.806292 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b7c9d-7144-40c8-9c78-bae118210594 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.818447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1082/2197] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:43.822688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea839a-13aa-4e3c-a61e-a0b73847866a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:43.836703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea839a-13aa-4e3c-a61e-a0b73847866a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:43.850774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:43.851628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.851914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.852224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] PATH_INFO: `/v3/projects/744b1f506976456ea0840f3165c2490f/users/7537d24d9adb4b81b55beaad505bd26a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.854687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744b1f506976456ea0840f3165c2490f, user_id=7537d24d9adb4b81b55beaad505bd26a, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:43.857868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:43.880619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1116/2198] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:43 2022] PUT /identity/v3/projects/744b1f506976456ea0840f3165c2490f/users/7537d24d9adb4b81b55beaad505bd26a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:43.892049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78cee2-38b9-4317-91c7-07c010b2f8ac None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:43.892527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78cee2-38b9-4317-91c7-07c010b2f8ac None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:43.893432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78cee2-38b9-4317-91c7-07c010b2f8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:43.925900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ab78cee2-38b9-4317-91c7-07c010b2f8ac None None] MFA Rules not processed for user `7537d24d9adb4b81b55beaad505bd26a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:43.927335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab78cee2-38b9-4317-91c7-07c010b2f8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:44.012910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:44.057905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1083/2199] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:44.070693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:44.072468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:44.078573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:44.166565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8f53b-d016-4c85-9fe6-801adff2b5c3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:44.173033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf29ca1-3692-4233-b6d4-6a08b76807cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:44.173843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29ca1-3692-4233-b6d4-6a08b76807cc service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:44.174396 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29ca1-3692-4233-b6d4-6a08b76807cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:44.174807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29ca1-3692-4233-b6d4-6a08b76807cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:44.187371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf29ca1-3692-4233-b6d4-6a08b76807cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:44.189455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf29ca1-3692-4233-b6d4-6a08b76807cc service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:44.201317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1117/2200] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:44.728883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78cee2-38b9-4317-91c7-07c010b2f8ac None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:44.738361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78cee2-38b9-4317-91c7-07c010b2f8ac None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:44.745314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7537d24d9adb4b81b55beaad505bd26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '744b1f506976456ea0840f3165c2490f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:44.745314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:44.745314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:44.745629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:44.745728 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:44.746207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:44.747868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:44.761697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1084/2201] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:44.765540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf29ca1-3692-4233-b6d4-6a08b76807cc service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:44.776039 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf29ca1-3692-4233-b6d4-6a08b76807cc service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:44.790548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d00ded-6455-4281-b211-c95baeb7badf tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7537d24d9adb4b81b55beaad505bd26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '744b1f506976456ea0840f3165c2490f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:44.791179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d00ded-6455-4281-b211-c95baeb7badf tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:44.791928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d00ded-6455-4281-b211-c95baeb7badf tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:44.791928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d00ded-6455-4281-b211-c95baeb7badf tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:44.792527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d00ded-6455-4281-b211-c95baeb7badf tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:44.794475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d00ded-6455-4281-b211-c95baeb7badf tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:44.838196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1118/2202] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:44 2022] POST /identity/v3/projects => generated 354 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:44.842439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:44.854520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfc49d-e274-465b-bccd-271703ade5a9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:44.943983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7537d24d9adb4b81b55beaad505bd26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '744b1f506976456ea0840f3165c2490f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:44.944477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:44.944764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:44.945082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:44.945736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:44.946040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:44.947804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:44.963958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1085/2203] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:45.037278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d00ded-6455-4281-b211-c95baeb7badf tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:45.048966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d00ded-6455-4281-b211-c95baeb7badf tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:45.063171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7537d24d9adb4b81b55beaad505bd26a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '744b1f506976456ea0840f3165c2490f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:45.063834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:45.064128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:45.064402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] PATH_INFO: `/v3/projects/cb7b728a5f074b0d9e05c92e304368be` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:45.065698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb7b728a5f074b0d9e05c92e304368be)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:45.067799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:45.153076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb7b728a5f074b0d9e05c92e304368be', 'request_id': 'req-41e67560-43bb-4c2f-8a50-66f9e1203c78'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.166014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb7b728a5f074b0d9e05c92e304368be', 'request_id': 'req-41e67560-43bb-4c2f-8a50-66f9e1203c78'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.181197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb7b728a5f074b0d9e05c92e304368be', 'request_id': 'req-41e67560-43bb-4c2f-8a50-66f9e1203c78'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.207958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] The token cache is being invalidate because project cb7b728a5f074b0d9e05c92e304368be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:45.208552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.210283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41e67560-43bb-4c2f-8a50-66f9e1203c78 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.212635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1119/2204] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:45 2022] DELETE /identity/v3/projects/cb7b728a5f074b0d9e05c92e304368be => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:45.581469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:45.583749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:45.696478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418865a-f874-47ee-95e1-17da62cb15f9 tempest-VolumeQuotaClassesTest-858690707 tempest-VolumeQuotaClassesTest-858690707-project-admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:45.790580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:45.791652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:45.792107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:45.792559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] PATH_INFO: `/v3/users/44113df263fc4932b30c6bf6e3875713` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:45.794208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44113df263fc4932b30c6bf6e3875713)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:45.796451 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:45.819175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:45.869912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44113df263fc4932b30c6bf6e3875713'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.884817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44113df263fc4932b30c6bf6e3875713'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.885596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44113df263fc4932b30c6bf6e3875713'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.894901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44113df263fc4932b30c6bf6e3875713'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.895561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44113df263fc4932b30c6bf6e3875713'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:45.926667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1086/2205] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:45 2022] DELETE /identity/v3/users/44113df263fc4932b30c6bf6e3875713 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:45.929257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256df36-3dd4-4d4c-9b13-5ea7e211f0ac None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:45.930070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256df36-3dd4-4d4c-9b13-5ea7e211f0ac None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:45.930487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256df36-3dd4-4d4c-9b13-5ea7e211f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:45.957820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c256df36-3dd4-4d4c-9b13-5ea7e211f0ac None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:45.958978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c256df36-3dd4-4d4c-9b13-5ea7e211f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:46.062268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1120/2206] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:46.074899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:46.076945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:46.176819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48662635-deab-4e87-b22d-8850d4b004d4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:46.193610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:46.196484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:46.197051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:46.197566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:46.223329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:46.225575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:46.248270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1087/2207] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:46.650725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a2482-bd72-466f-bf63-aedc9b9f62cb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:46.651022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a2482-bd72-466f-bf63-aedc9b9f62cb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:46.651299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a2482-bd72-466f-bf63-aedc9b9f62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:46.667529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:46.690279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-164a2482-bd72-466f-bf63-aedc9b9f62cb None None] MFA Rules not processed for user `549d0ae567994dc5b58f24fbb614363b`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:46.691595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-164a2482-bd72-466f-bf63-aedc9b9f62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:46.864014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1121/2208] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:46.879792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:46.881893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:47.018627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a2482-bd72-466f-bf63-aedc9b9f62cb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:47.020579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-164a2482-bd72-466f-bf63-aedc9b9f62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:47.024467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac56d56-7567-444a-a0b5-ea80ebba3270 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:47.043615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f3e2-4b13-4120-9b7d-9cb73bb9c5ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:47.044913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f3e2-4b13-4120-9b7d-9cb73bb9c5ab service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:47.045303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f3e2-4b13-4120-9b7d-9cb73bb9c5ab service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:47.045580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f3e2-4b13-4120-9b7d-9cb73bb9c5ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:47.050180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a2482-bd72-466f-bf63-aedc9b9f62cb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:47.062283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:47.062732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:47.064209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:47.064705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] PATH_INFO: `/v3/projects/43828350c50441e3bcf11d631027e9a6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:47.066346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=43828350c50441e3bcf11d631027e9a6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:47.069970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:47.071231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f3e2-4b13-4120-9b7d-9cb73bb9c5ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:47.073210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f3e2-4b13-4120-9b7d-9cb73bb9c5ab service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:47.090539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1088/2209] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:47.151603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43828350c50441e3bcf11d631027e9a6', 'request_id': 'req-9c172008-8cf8-43a2-a104-9441a67ab9ad'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.166131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43828350c50441e3bcf11d631027e9a6', 'request_id': 'req-9c172008-8cf8-43a2-a104-9441a67ab9ad'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.177483 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43828350c50441e3bcf11d631027e9a6', 'request_id': 'req-9c172008-8cf8-43a2-a104-9441a67ab9ad'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.225737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] The token cache is being invalidate because project 43828350c50441e3bcf11d631027e9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:47.226035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.226766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.231199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1122/2210] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:47 2022] DELETE /identity/v3/projects/43828350c50441e3bcf11d631027e9a6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:47.233788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f3e2-4b13-4120-9b7d-9cb73bb9c5ab service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:47.254650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f3e2-4b13-4120-9b7d-9cb73bb9c5ab service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:47.293674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:47.372658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:47.373380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:47.373687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:47.373962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] PATH_INFO: `/v3/users/7537d24d9adb4b81b55beaad505bd26a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:47.375105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7537d24d9adb4b81b55beaad505bd26a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:47.377089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:47.435431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7537d24d9adb4b81b55beaad505bd26a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.461234 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7537d24d9adb4b81b55beaad505bd26a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.462095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7537d24d9adb4b81b55beaad505bd26a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.473141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7537d24d9adb4b81b55beaad505bd26a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.473834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9606bb2a-523a-45a8-9ed6-bf3860ab6958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7537d24d9adb4b81b55beaad505bd26a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:47.489587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1089/2211] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:47 2022] DELETE /identity/v3/users/7537d24d9adb4b81b55beaad505bd26a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:47.882311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:47.883932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:47.899901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c172008-8cf8-43a2-a104-9441a67ab9ad admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:47.989879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:47.990635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:47.991226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:47.992002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] PATH_INFO: `/v3/projects/744b1f506976456ea0840f3165c2490f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:47.993998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] RBAC: Authorizing `identity:delete_project(project_id=744b1f506976456ea0840f3165c2490f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:47.995455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:48.036828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:48.073718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744b1f506976456ea0840f3165c2490f', 'request_id': 'req-8e5e6866-5b96-4738-bc38-419153ba269f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:48.080222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744b1f506976456ea0840f3165c2490f', 'request_id': 'req-8e5e6866-5b96-4738-bc38-419153ba269f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:48.087585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744b1f506976456ea0840f3165c2490f', 'request_id': 'req-8e5e6866-5b96-4738-bc38-419153ba269f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:48.114868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] The token cache is being invalidate because project 744b1f506976456ea0840f3165c2490f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:48.114977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:48.115702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8e5e6866-5b96-4738-bc38-419153ba269f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:48.117913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1123/2212] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:47 2022] DELETE /identity/v3/projects/744b1f506976456ea0840f3165c2490f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:48.127117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32421c0-71a5-4459-a73c-93fe2b96dd7f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.128109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32421c0-71a5-4459-a73c-93fe2b96dd7f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.128625 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32421c0-71a5-4459-a73c-93fe2b96dd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.159581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a32421c0-71a5-4459-a73c-93fe2b96dd7f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:48.176617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a32421c0-71a5-4459-a73c-93fe2b96dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:48.289337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1090/2213] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:48.299814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033126-8452-412d-aed3-49fe8e13cbcb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.300145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033126-8452-412d-aed3-49fe8e13cbcb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.300425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74033126-8452-412d-aed3-49fe8e13cbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.323792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-74033126-8452-412d-aed3-49fe8e13cbcb None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:48.325711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-74033126-8452-412d-aed3-49fe8e13cbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:48.347378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32421c0-71a5-4459-a73c-93fe2b96dd7f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:48.349054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1124/2214] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:48.364300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32421c0-71a5-4459-a73c-93fe2b96dd7f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:48.372446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:48.372446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.372446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.372446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.372852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:48.373343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:48.374932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:48.390665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1091/2215] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:48.395202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74033126-8452-412d-aed3-49fe8e13cbcb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:48.407584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74033126-8452-412d-aed3-49fe8e13cbcb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:48.416556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1923-3103-494c-b70b-ec4a7ed2d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:48.417528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1923-3103-494c-b70b-ec4a7ed2d634 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.417869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1923-3103-494c-b70b-ec4a7ed2d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.418368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca1923-3103-494c-b70b-ec4a7ed2d634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.419100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca1923-3103-494c-b70b-ec4a7ed2d634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:48.421168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca1923-3103-494c-b70b-ec4a7ed2d634 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:48.466942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1125/2216] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:48 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:48.470941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:48.489342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b24df-0607-48f8-969d-1f095bb74cc8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:48.518950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:48.610458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e126f18-be8a-41e1-9acc-ce72cf7241df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:48.612488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e126f18-be8a-41e1-9acc-ce72cf7241df admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.612880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e126f18-be8a-41e1-9acc-ce72cf7241df admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.613433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e126f18-be8a-41e1-9acc-ce72cf7241df admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.616801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e126f18-be8a-41e1-9acc-ce72cf7241df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:48.619668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e126f18-be8a-41e1-9acc-ce72cf7241df admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:48.666089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1092/2217] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:48 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:48.669992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1923-3103-494c-b70b-ec4a7ed2d634 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:48.682099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca1923-3103-494c-b70b-ec4a7ed2d634 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:48.687900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bac5b-5cad-4775-8e3a-052ced1b7be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:48.688959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bac5b-5cad-4775-8e3a-052ced1b7be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.689679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bac5b-5cad-4775-8e3a-052ced1b7be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.690265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bac5b-5cad-4775-8e3a-052ced1b7be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.691835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bac5b-5cad-4775-8e3a-052ced1b7be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:48.693386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bac5b-5cad-4775-8e3a-052ced1b7be4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:48.705964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1126/2218] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:48.710695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e126f18-be8a-41e1-9acc-ce72cf7241df admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:48.724000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e126f18-be8a-41e1-9acc-ce72cf7241df admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:48.730355 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4393c8-ede2-4461-93d3-48c470989539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:48.730698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4393c8-ede2-4461-93d3-48c470989539 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.731063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4393c8-ede2-4461-93d3-48c470989539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.731249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4393c8-ede2-4461-93d3-48c470989539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.732003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4393c8-ede2-4461-93d3-48c470989539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:48.734834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4393c8-ede2-4461-93d3-48c470989539 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:48.768465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bac5b-5cad-4775-8e3a-052ced1b7be4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:48.775712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1093/2219] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:48.784363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bac5b-5cad-4775-8e3a-052ced1b7be4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:48.814048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:48.816763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.817274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.820315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] PATH_INFO: `/v3/projects/ab9eca4d8596419baa4222bb45e7b728/users/647886a9b30840ee8207a53dfd68adf9/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.873771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9eca4d8596419baa4222bb45e7b728, user_id=647886a9b30840ee8207a53dfd68adf9, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:48.877900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:48.919696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1127/2220] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:48 2022] PUT /identity/v3/projects/ab9eca4d8596419baa4222bb45e7b728/users/647886a9b30840ee8207a53dfd68adf9/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:48.930891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72fba6-6387-4177-948d-70cb5527fbe6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:48.931081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72fba6-6387-4177-948d-70cb5527fbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:48.931354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72fba6-6387-4177-948d-70cb5527fbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:48.978285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0e72fba6-6387-4177-948d-70cb5527fbe6 None None] MFA Rules not processed for user `647886a9b30840ee8207a53dfd68adf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:48.979580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0e72fba6-6387-4177-948d-70cb5527fbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.074527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1094/2221] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:49.084602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:49.086577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.150325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b229d-3761-4f58-88f5-dfd3e2eb0279 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:49.154573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749af3b-2a73-49a1-aa42-692bac202ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:49.155575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749af3b-2a73-49a1-aa42-692bac202ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.155999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749af3b-2a73-49a1-aa42-692bac202ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.156446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749af3b-2a73-49a1-aa42-692bac202ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.166738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fd9e-373f-47ec-9329-0a0bfc485551 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.167956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fd9e-373f-47ec-9329-0a0bfc485551 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.168448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112fd9e-373f-47ec-9329-0a0bfc485551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.168559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749af3b-2a73-49a1-aa42-692bac202ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:49.170035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749af3b-2a73-49a1-aa42-692bac202ea2 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:49.181394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1128/2222] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:49.188998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a112fd9e-373f-47ec-9329-0a0bfc485551 None None] MFA Rules not processed for user `549d0ae567994dc5b58f24fbb614363b`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:49.190382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a112fd9e-373f-47ec-9329-0a0bfc485551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.203466 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749af3b-2a73-49a1-aa42-692bac202ea2 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:49.254215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1095/2223] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:49.283916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:49.306780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749af3b-2a73-49a1-aa42-692bac202ea2 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:49.317899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:49.319612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.320203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.320714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] PATH_INFO: `/v3/users/647886a9b30840ee8207a53dfd68adf9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.322201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647886a9b30840ee8207a53dfd68adf9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:49.325034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:49.390095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647886a9b30840ee8207a53dfd68adf9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.404593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647886a9b30840ee8207a53dfd68adf9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.405507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647886a9b30840ee8207a53dfd68adf9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.414239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647886a9b30840ee8207a53dfd68adf9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.414870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647886a9b30840ee8207a53dfd68adf9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.428940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1129/2224] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:49 2022] DELETE /identity/v3/users/647886a9b30840ee8207a53dfd68adf9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:49.434647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78452130-2bf7-49c8-a6d8-052e044f600c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.435185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78452130-2bf7-49c8-a6d8-052e044f600c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.435521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78452130-2bf7-49c8-a6d8-052e044f600c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.450129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:49.452227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.458307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-78452130-2bf7-49c8-a6d8-052e044f600c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:49.459919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-78452130-2bf7-49c8-a6d8-052e044f600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.498513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:49.531794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9638f8-4a63-487e-beb1-436f329c0211 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:49.538515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:49.539260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.542322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.542678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] PATH_INFO: `/v3/users/a5e60dd9b2d74548815979a02ba16c3a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.544044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e60dd9b2d74548815979a02ba16c3a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:49.544425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1096/2225] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:49.546424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:49.556053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78452130-2bf7-49c8-a6d8-052e044f600c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:49.557548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-78452130-2bf7-49c8-a6d8-052e044f600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.605419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e60dd9b2d74548815979a02ba16c3a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.621055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e60dd9b2d74548815979a02ba16c3a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.621910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e60dd9b2d74548815979a02ba16c3a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.626623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:49.627421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78452130-2bf7-49c8-a6d8-052e044f600c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:49.633441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:49.634272 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.634621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.634793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e60dd9b2d74548815979a02ba16c3a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.635010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.635663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-02416b90-0659-4696-b41a-c60ea7f3b58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e60dd9b2d74548815979a02ba16c3a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:49.637200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.650840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:49.652783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:49.658775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1130/2226] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:49 2022] DELETE /identity/v3/users/a5e60dd9b2d74548815979a02ba16c3a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:49.663205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3407b6-2288-447b-b5fc-3e6d5d01dee3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.663495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3407b6-2288-447b-b5fc-3e6d5d01dee3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.663766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1097/2227] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:49.663877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3407b6-2288-447b-b5fc-3e6d5d01dee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.684416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4b3407b6-2288-447b-b5fc-3e6d5d01dee3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:49.688237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4b3407b6-2288-447b-b5fc-3e6d5d01dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.765286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1131/2228] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:49.775767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:49.777336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:49.792524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6dbf3-d3e4-4176-b906-9f275c1c89e9 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:49.893768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cda0b-e3cf-4bf9-9f76-acf3798c6adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:49.894442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cda0b-e3cf-4bf9-9f76-acf3798c6adc service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:49.894727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cda0b-e3cf-4bf9-9f76-acf3798c6adc service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:49.895152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cda0b-e3cf-4bf9-9f76-acf3798c6adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:49.911222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cda0b-e3cf-4bf9-9f76-acf3798c6adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:49.914481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cda0b-e3cf-4bf9-9f76-acf3798c6adc service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:49.927358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1098/2229] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:50.052864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3407b6-2288-447b-b5fc-3e6d5d01dee3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:50.054561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4b3407b6-2288-447b-b5fc-3e6d5d01dee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:50.097831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3407b6-2288-447b-b5fc-3e6d5d01dee3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:50.122093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:50.125274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.126815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.128171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] PATH_INFO: `/v3/projects/ab9eca4d8596419baa4222bb45e7b728` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.135144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9eca4d8596419baa4222bb45e7b728)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:50.139182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:50.232843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9eca4d8596419baa4222bb45e7b728', 'request_id': 'req-94976390-808c-4383-9495-b5a0c80cf63b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.241007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9eca4d8596419baa4222bb45e7b728', 'request_id': 'req-94976390-808c-4383-9495-b5a0c80cf63b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.254035 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9eca4d8596419baa4222bb45e7b728', 'request_id': 'req-94976390-808c-4383-9495-b5a0c80cf63b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.273853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] The token cache is being invalidate because project ab9eca4d8596419baa4222bb45e7b728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:50.275541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.276669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.279206 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1132/2230] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:50 2022] DELETE /identity/v3/projects/ab9eca4d8596419baa4222bb45e7b728 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:50.284750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae099ea0-b92e-4db6-b8ea-3b0992cacb1a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.285323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae099ea0-b92e-4db6-b8ea-3b0992cacb1a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.285323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae099ea0-b92e-4db6-b8ea-3b0992cacb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.371734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ae099ea0-b92e-4db6-b8ea-3b0992cacb1a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:50.413177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ae099ea0-b92e-4db6-b8ea-3b0992cacb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:50.471791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:50.473348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:50.532823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1099/2231] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:50.542288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd5db-b946-4a2a-95a4-cb0244d61a27 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.542480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd5db-b946-4a2a-95a4-cb0244d61a27 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.542721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd5db-b946-4a2a-95a4-cb0244d61a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.574077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ffcdd5db-b946-4a2a-95a4-cb0244d61a27 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:50.575602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ffcdd5db-b946-4a2a-95a4-cb0244d61a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:50.588667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1100/2232] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:50.589606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdd5db-b946-4a2a-95a4-cb0244d61a27 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:50.602945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdd5db-b946-4a2a-95a4-cb0244d61a27 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:50.618418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:50.619147 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.620226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.620226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.623145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94976390-808c-4383-9495-b5a0c80cf63b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:50.624446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:50.624766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:50.626956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:50.635006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:50.636663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.637254 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.638474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] PATH_INFO: `/v3/projects/ad2865ea5a914dd696e713d6058e0d7d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.640634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2865ea5a914dd696e713d6058e0d7d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:50.643522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:50.644707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1101/2233] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:50.645686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:50.654706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:50.663376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:50.664676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf267f1-0e5f-413a-b6ff-cc10a9c76e05 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:50.679854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d95142-5abe-4435-8b42-8a02e9e09a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:50.679854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95142-5abe-4435-8b42-8a02e9e09a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.680444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95142-5abe-4435-8b42-8a02e9e09a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.680792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d95142-5abe-4435-8b42-8a02e9e09a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.682343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95142-5abe-4435-8b42-8a02e9e09a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:50.686421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d95142-5abe-4435-8b42-8a02e9e09a0f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:50.739301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2865ea5a914dd696e713d6058e0d7d', 'request_id': 'req-2c440ec5-31e1-48e9-8436-c4e046fa0471'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.746756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2865ea5a914dd696e713d6058e0d7d', 'request_id': 'req-2c440ec5-31e1-48e9-8436-c4e046fa0471'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.756897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1102/2234] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:50 2022] POST /identity/v3/projects => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:50.761399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2865ea5a914dd696e713d6058e0d7d', 'request_id': 'req-2c440ec5-31e1-48e9-8436-c4e046fa0471'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.762930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d95142-5abe-4435-8b42-8a02e9e09a0f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:50.789427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] The token cache is being invalidate because project ad2865ea5a914dd696e713d6058e0d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:50.790148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.791136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2c440ec5-31e1-48e9-8436-c4e046fa0471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:50.793662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1133/2235] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:50 2022] DELETE /identity/v3/projects/ad2865ea5a914dd696e713d6058e0d7d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:50.800832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82ad0-7803-4d72-aac6-7f61f6b5c7b5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.801572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82ad0-7803-4d72-aac6-7f61f6b5c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.802097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b82ad0-7803-4d72-aac6-7f61f6b5c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.858505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-24b82ad0-7803-4d72-aac6-7f61f6b5c7b5 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:50.860236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-24b82ad0-7803-4d72-aac6-7f61f6b5c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:50.894193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d95142-5abe-4435-8b42-8a02e9e09a0f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:50.903529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:50.905011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.906000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.909217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.909967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:50.913044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:50.955372 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1103/2236] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:50 2022] POST /identity/v3/users => generated 280 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:50.961457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:50.968569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:50.983755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1134/2237] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:50.983965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4587e-fb8d-49a3-b928-af98dce2c5e8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:50.986240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63575ea-6874-4c7e-bea5-3ebe646484a6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.986525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63575ea-6874-4c7e-bea5-3ebe646484a6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.986810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63575ea-6874-4c7e-bea5-3ebe646484a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.993541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550278f3-619c-43c3-8dce-2c9fcda655c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:50.994290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550278f3-619c-43c3-8dce-2c9fcda655c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:50.994674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550278f3-619c-43c3-8dce-2c9fcda655c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:50.995054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550278f3-619c-43c3-8dce-2c9fcda655c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:50.995886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550278f3-619c-43c3-8dce-2c9fcda655c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:50.997576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550278f3-619c-43c3-8dce-2c9fcda655c7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.012109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1104/2238] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:51.012298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e63575ea-6874-4c7e-bea5-3ebe646484a6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:51.012802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e63575ea-6874-4c7e-bea5-3ebe646484a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:51.013392 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550278f3-619c-43c3-8dce-2c9fcda655c7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.021438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1135/2239] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:51.024691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550278f3-619c-43c3-8dce-2c9fcda655c7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.025441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63575ea-6874-4c7e-bea5-3ebe646484a6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.029601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca19e9-e884-4abc-928b-22c1bf933431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.030232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca19e9-e884-4abc-928b-22c1bf933431 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.030518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca19e9-e884-4abc-928b-22c1bf933431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.030799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca19e9-e884-4abc-928b-22c1bf933431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.031539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca19e9-e884-4abc-928b-22c1bf933431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.033849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca19e9-e884-4abc-928b-22c1bf933431 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.035954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63575ea-6874-4c7e-bea5-3ebe646484a6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.042416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.043176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.043559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.044121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.044995 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:51.045503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.047047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.048639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1105/2240] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:51.054066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca19e9-e884-4abc-928b-22c1bf933431 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.060890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1136/2241] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:00:51.065170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.066746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca19e9-e884-4abc-928b-22c1bf933431 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.072528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785d29-cd2a-4746-8ffd-6d78d10ee112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.073478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785d29-cd2a-4746-8ffd-6d78d10ee112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.073972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785d29-cd2a-4746-8ffd-6d78d10ee112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.074249 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785d29-cd2a-4746-8ffd-6d78d10ee112 admin admin] PATH_INFO: `/v3/projects/3b5f736f7e874c7fbd57434db3641a17/users/6cf86f78cae64b4287d725ac8472ad0f/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.078456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6fb23-686a-40c9-b2db-ab35f8964b14 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.083557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1b32-3b42-4369-bb38-9820a36f506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.084321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1b32-3b42-4369-bb38-9820a36f506a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.084608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1b32-3b42-4369-bb38-9820a36f506a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.084918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac1b32-3b42-4369-bb38-9820a36f506a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.085601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac1b32-3b42-4369-bb38-9820a36f506a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.087558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac1b32-3b42-4369-bb38-9820a36f506a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.091182 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f785d29-cd2a-4746-8ffd-6d78d10ee112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b5f736f7e874c7fbd57434db3641a17, user_id=6cf86f78cae64b4287d725ac8472ad0f, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.093971 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f785d29-cd2a-4746-8ffd-6d78d10ee112 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.114029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1106/2242] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:51 2022] PUT /identity/v3/projects/3b5f736f7e874c7fbd57434db3641a17/users/6cf86f78cae64b4287d725ac8472ad0f/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:51.123408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1137/2243] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:51 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:51.126148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990b00b-83e0-46b6-a611-99a6251d159d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.126327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990b00b-83e0-46b6-a611-99a6251d159d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.126637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990b00b-83e0-46b6-a611-99a6251d159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.128304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1b32-3b42-4369-bb38-9820a36f506a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.160681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4990b00b-83e0-46b6-a611-99a6251d159d None None] MFA Rules not processed for user `6cf86f78cae64b4287d725ac8472ad0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:51.161968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4990b00b-83e0-46b6-a611-99a6251d159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:51.196890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac1b32-3b42-4369-bb38-9820a36f506a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.209872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.210847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.211133 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.211575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.212375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.215445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.228059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:51.236067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1107/2244] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:51.265195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1138/2245] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:51 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:51.269178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990b00b-83e0-46b6-a611-99a6251d159d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.277787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990b00b-83e0-46b6-a611-99a6251d159d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.282298 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.284211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:51.284889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2296-9fc8-48a8-81ee-c530afc50a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.285688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2296-9fc8-48a8-81ee-c530afc50a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.285974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2296-9fc8-48a8-81ee-c530afc50a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.286248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2296-9fc8-48a8-81ee-c530afc50a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.286898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2296-9fc8-48a8-81ee-c530afc50a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.289067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2296-9fc8-48a8-81ee-c530afc50a38 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.301345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1108/2246] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:51.306024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2296-9fc8-48a8-81ee-c530afc50a38 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.312755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:51.317718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2296-9fc8-48a8-81ee-c530afc50a38 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.323683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f4d93-94e3-446d-94a7-a0d919b65ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.324512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4d93-94e3-446d-94a7-a0d919b65ded admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.325091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4d93-94e3-446d-94a7-a0d919b65ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.325539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f4d93-94e3-446d-94a7-a0d919b65ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.326368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f4d93-94e3-446d-94a7-a0d919b65ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.327987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f4d93-94e3-446d-94a7-a0d919b65ded admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.339692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1109/2247] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:51.343404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f4d93-94e3-446d-94a7-a0d919b65ded admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.352952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434aa9f-e4ba-46bd-8f85-4772b1340c73 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.354924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f4d93-94e3-446d-94a7-a0d919b65ded admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.357171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39cf2-f112-4361-8ace-9d7aee10134e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.357923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39cf2-f112-4361-8ace-9d7aee10134e service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.358033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39cf2-f112-4361-8ace-9d7aee10134e service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.358280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39cf2-f112-4361-8ace-9d7aee10134e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.360091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089d57f-db1d-4d41-8720-04aec0e9399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.360733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d57f-db1d-4d41-8720-04aec0e9399e admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.361909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d57f-db1d-4d41-8720-04aec0e9399e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.362233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089d57f-db1d-4d41-8720-04aec0e9399e admin admin] PATH_INFO: `/v3/projects/8f61594c21634d828c377fb7be724b52/users/f61f3182cb9d48d0ba6f417e2afb0809/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.368211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f39cf2-f112-4361-8ace-9d7aee10134e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.369818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f39cf2-f112-4361-8ace-9d7aee10134e service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.380376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089d57f-db1d-4d41-8720-04aec0e9399e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f61594c21634d828c377fb7be724b52, user_id=f61f3182cb9d48d0ba6f417e2afb0809, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.381025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1139/2248] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:00:51.383124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089d57f-db1d-4d41-8720-04aec0e9399e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.398198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39cf2-f112-4361-8ace-9d7aee10134e service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.405595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1110/2249] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:51 2022] PUT /identity/v3/projects/8f61594c21634d828c377fb7be724b52/users/f61f3182cb9d48d0ba6f417e2afb0809/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:51.410261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555badc-cd70-43f0-948d-586c7af4db4b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.410547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555badc-cd70-43f0-948d-586c7af4db4b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.410824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555badc-cd70-43f0-948d-586c7af4db4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.411672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39cf2-f112-4361-8ace-9d7aee10134e service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.437232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9555badc-cd70-43f0-948d-586c7af4db4b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:51.439956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9555badc-cd70-43f0-948d-586c7af4db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:51.530889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.532030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.532398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.532887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] PATH_INFO: `/v3/users/6cf86f78cae64b4287d725ac8472ad0f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.534757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf86f78cae64b4287d725ac8472ad0f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.538709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.546571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1111/2250] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:51.565854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555badc-cd70-43f0-948d-586c7af4db4b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.569336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9555badc-cd70-43f0-948d-586c7af4db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:51.636857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf86f78cae64b4287d725ac8472ad0f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:51.656480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf86f78cae64b4287d725ac8472ad0f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:51.657723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf86f78cae64b4287d725ac8472ad0f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:51.675770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf86f78cae64b4287d725ac8472ad0f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:51.676634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a974f30-7f9d-44a7-addf-3d866f770272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf86f78cae64b4287d725ac8472ad0f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:51.676813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555badc-cd70-43f0-948d-586c7af4db4b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.681539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.682300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.682586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.682913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.685353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:51.696764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1140/2251] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:51 2022] DELETE /identity/v3/users/6cf86f78cae64b4287d725ac8472ad0f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:51.700328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.701850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15742-7956-40c1-8b23-dfce5ed35b0a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.701975 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.702326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15742-7956-40c1-8b23-dfce5ed35b0a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.702704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac15742-7956-40c1-8b23-dfce5ed35b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.714812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1112/2252] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:51.737371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cac15742-7956-40c1-8b23-dfce5ed35b0a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:51.738592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cac15742-7956-40c1-8b23-dfce5ed35b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:51.744577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:51.809952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1141/2253] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:51.820899 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:51.822978 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:51.840570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52806b-7f14-4be3-bc3f-cb9ed53c5951 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:51.892753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cd5e2-20fa-4f51-9b56-31caf529b736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:51.893423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cd5e2-20fa-4f51-9b56-31caf529b736 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:51.893844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cd5e2-20fa-4f51-9b56-31caf529b736 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:51.894124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cd5e2-20fa-4f51-9b56-31caf529b736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:51.910106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cd5e2-20fa-4f51-9b56-31caf529b736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:51.911771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cd5e2-20fa-4f51-9b56-31caf529b736 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:51.923307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1113/2254] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:52.471172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac15742-7956-40c1-8b23-dfce5ed35b0a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:52.472997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cac15742-7956-40c1-8b23-dfce5ed35b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:52.532118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac15742-7956-40c1-8b23-dfce5ed35b0a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:52.541802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:52.547058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.547389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.547651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] PATH_INFO: `/v3/projects/3b5f736f7e874c7fbd57434db3641a17` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:52.552397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b5f736f7e874c7fbd57434db3641a17)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:52.564003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:52.644487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b5f736f7e874c7fbd57434db3641a17', 'request_id': 'req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:52.664640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b5f736f7e874c7fbd57434db3641a17', 'request_id': 'req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:52.672407 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b5f736f7e874c7fbd57434db3641a17', 'request_id': 'req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:52.699666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] The token cache is being invalidate because project 3b5f736f7e874c7fbd57434db3641a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:00:52.700221 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:52.701168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-91f1a6be-8a0b-4c3f-83d2-6ac1c3d1b673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:00:52.703394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1142/2255] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:00:52 2022] DELETE /identity/v3/projects/3b5f736f7e874c7fbd57434db3641a17 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:52.708668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266c67-3d1e-4886-915d-266b79958226 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.709264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266c67-3d1e-4886-915d-266b79958226 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.709264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30266c67-3d1e-4886-915d-266b79958226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:52.736964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-30266c67-3d1e-4886-915d-266b79958226 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:52.738278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-30266c67-3d1e-4886-915d-266b79958226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:52.757906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:52.835411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1114/2256] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:52.837502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613dda-45c6-439e-8ad6-540d6e0c0d2d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.837795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613dda-45c6-439e-8ad6-540d6e0c0d2d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.838076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613dda-45c6-439e-8ad6-540d6e0c0d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:52.866560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a5613dda-45c6-439e-8ad6-540d6e0c0d2d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:52.867813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a5613dda-45c6-439e-8ad6-540d6e0c0d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:52.879243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1143/2257] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:00:52.883907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30266c67-3d1e-4886-915d-266b79958226 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:52.893959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30266c67-3d1e-4886-915d-266b79958226 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:52.898912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:52.899601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.899850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.900121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:52.900953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:00:52.901300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:52.902963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:52.919493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1115/2258] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:00:52.920690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5613dda-45c6-439e-8ad6-540d6e0c0d2d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:52.934879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5613dda-45c6-439e-8ad6-540d6e0c0d2d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:52.942178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1fab-41c3-4974-9a8a-c7a5722b079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:52.942807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1fab-41c3-4974-9a8a-c7a5722b079d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:52.943137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1fab-41c3-4974-9a8a-c7a5722b079d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:52.943425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a1fab-41c3-4974-9a8a-c7a5722b079d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:52.944042 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a1fab-41c3-4974-9a8a-c7a5722b079d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:52.946593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a1fab-41c3-4974-9a8a-c7a5722b079d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:52.975683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1144/2259] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:52 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:52.980800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.004595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43538b9-2452-49f2-9b66-ce96b7c81753 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.093844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0a886-a846-46c9-8514-db3befc44852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.094484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0a886-a846-46c9-8514-db3befc44852 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.094764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0a886-a846-46c9-8514-db3befc44852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.095187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0a886-a846-46c9-8514-db3befc44852 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.095830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0a886-a846-46c9-8514-db3befc44852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.097830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0a886-a846-46c9-8514-db3befc44852 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.136401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1116/2260] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:52 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:53.138213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1fab-41c3-4974-9a8a-c7a5722b079d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.149722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a1fab-41c3-4974-9a8a-c7a5722b079d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.155354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d04e8f-dc17-4e09-a566-0a37ed3c8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.156231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d04e8f-dc17-4e09-a566-0a37ed3c8da2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.156657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d04e8f-dc17-4e09-a566-0a37ed3c8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.156950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d04e8f-dc17-4e09-a566-0a37ed3c8da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.158610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d04e8f-dc17-4e09-a566-0a37ed3c8da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.161211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d04e8f-dc17-4e09-a566-0a37ed3c8da2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.173119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1145/2261] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:53.176923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0a886-a846-46c9-8514-db3befc44852 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.188653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0a886-a846-46c9-8514-db3befc44852 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.193411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b0a38-9659-4d27-91c3-698d278fb3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.194636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0a38-9659-4d27-91c3-698d278fb3be admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.194915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0a38-9659-4d27-91c3-698d278fb3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.195186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0a38-9659-4d27-91c3-698d278fb3be admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.195835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b0a38-9659-4d27-91c3-698d278fb3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.197661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b0a38-9659-4d27-91c3-698d278fb3be admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.230928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1117/2262] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:53.231132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d04e8f-dc17-4e09-a566-0a37ed3c8da2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.257014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d04e8f-dc17-4e09-a566-0a37ed3c8da2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.265411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5f3ed-bafa-4085-a100-fe566de48e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.266662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f3ed-bafa-4085-a100-fe566de48e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.267233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f3ed-bafa-4085-a100-fe566de48e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.267553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f3ed-bafa-4085-a100-fe566de48e46 admin admin] PATH_INFO: `/v3/projects/d95bc34300874ae1bd43d20d7ffa4412/users/f9377f97c7dd465b8dd9d75488bd042b/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.291857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5f3ed-bafa-4085-a100-fe566de48e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95bc34300874ae1bd43d20d7ffa4412, user_id=f9377f97c7dd465b8dd9d75488bd042b, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.294595 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5f3ed-bafa-4085-a100-fe566de48e46 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.325514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1146/2263] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:53 2022] PUT /identity/v3/projects/d95bc34300874ae1bd43d20d7ffa4412/users/f9377f97c7dd465b8dd9d75488bd042b/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:00:53.335521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426720c-03d0-4d3f-94ab-cce0c028bb2a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.335521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426720c-03d0-4d3f-94ab-cce0c028bb2a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.335924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426720c-03d0-4d3f-94ab-cce0c028bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.399943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7426720c-03d0-4d3f-94ab-cce0c028bb2a None None] MFA Rules not processed for user `f9377f97c7dd465b8dd9d75488bd042b`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:53.401282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7426720c-03d0-4d3f-94ab-cce0c028bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:53.499335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1118/2264] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:53.508563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5f3ed-bafa-4085-a100-fe566de48e46 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.570481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:53.624482 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5f3ed-bafa-4085-a100-fe566de48e46 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.645372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129285eb-d8c4-4b77-b5f3-e97ffa36013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.646256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129285eb-d8c4-4b77-b5f3-e97ffa36013d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.646370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129285eb-d8c4-4b77-b5f3-e97ffa36013d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.646555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129285eb-d8c4-4b77-b5f3-e97ffa36013d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.647411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129285eb-d8c4-4b77-b5f3-e97ffa36013d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.649472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129285eb-d8c4-4b77-b5f3-e97ffa36013d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.683704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1147/2265] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:53 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:53.687734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426720c-03d0-4d3f-94ab-cce0c028bb2a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.699839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426720c-03d0-4d3f-94ab-cce0c028bb2a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.710468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:53.778742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6157-c212-465d-8728-a508fcad746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.779808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6157-c212-465d-8728-a508fcad746f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.780154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6157-c212-465d-8728-a508fcad746f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.780604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6157-c212-465d-8728-a508fcad746f admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.781515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6157-c212-465d-8728-a508fcad746f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.784879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6157-c212-465d-8728-a508fcad746f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.832300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1119/2266] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:53 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:53.833744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129285eb-d8c4-4b77-b5f3-e97ffa36013d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.853174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129285eb-d8c4-4b77-b5f3-e97ffa36013d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.859935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23c8b2-2024-48c7-9b3f-f4d6579df07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.860662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c8b2-2024-48c7-9b3f-f4d6579df07e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.860946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c8b2-2024-48c7-9b3f-f4d6579df07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.861255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c8b2-2024-48c7-9b3f-f4d6579df07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.862125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23c8b2-2024-48c7-9b3f-f4d6579df07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.863965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23c8b2-2024-48c7-9b3f-f4d6579df07e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.879369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1148/2267] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:53.884334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6157-c212-465d-8728-a508fcad746f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.903240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6157-c212-465d-8728-a508fcad746f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.910801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911d491-7c78-4407-be15-2e8b00a676e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.911020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911d491-7c78-4407-be15-2e8b00a676e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.911394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911d491-7c78-4407-be15-2e8b00a676e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.911743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911d491-7c78-4407-be15-2e8b00a676e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.912523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911d491-7c78-4407-be15-2e8b00a676e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:53.914704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911d491-7c78-4407-be15-2e8b00a676e7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:53.926471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1120/2268] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:53.931639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23c8b2-2024-48c7-9b3f-f4d6579df07e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:53.942815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23c8b2-2024-48c7-9b3f-f4d6579df07e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:53.948663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81931449-7f82-4bc4-a88a-87ccbecfd43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:53.949757 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81931449-7f82-4bc4-a88a-87ccbecfd43e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:53.950009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81931449-7f82-4bc4-a88a-87ccbecfd43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:53.950288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81931449-7f82-4bc4-a88a-87ccbecfd43e admin admin] PATH_INFO: `/v3/projects/3d8934d98ba445d7ab63937f37117614/users/ed06b6d21d65460bad760473d7a8cf88/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:53.994790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81931449-7f82-4bc4-a88a-87ccbecfd43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8934d98ba445d7ab63937f37117614, user_id=ed06b6d21d65460bad760473d7a8cf88, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:54.003969 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81931449-7f82-4bc4-a88a-87ccbecfd43e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:54.026376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1149/2269] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:53 2022] PUT /identity/v3/projects/3d8934d98ba445d7ab63937f37117614/users/ed06b6d21d65460bad760473d7a8cf88/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:54.042121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481216-4dfa-48f3-a7d6-57186e2e9ff3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.042654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481216-4dfa-48f3-a7d6-57186e2e9ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.043175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481216-4dfa-48f3-a7d6-57186e2e9ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.078872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8c481216-4dfa-48f3-a7d6-57186e2e9ff3 None None] MFA Rules not processed for user `ed06b6d21d65460bad760473d7a8cf88`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:54.081446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8c481216-4dfa-48f3-a7d6-57186e2e9ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:54.170541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1121/2270] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:54.175367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81931449-7f82-4bc4-a88a-87ccbecfd43e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:54.239973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81931449-7f82-4bc4-a88a-87ccbecfd43e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:54.246514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e302ad0-7c8e-4802-bf7c-67e8db72545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:54.247339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e302ad0-7c8e-4802-bf7c-67e8db72545b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.247339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e302ad0-7c8e-4802-bf7c-67e8db72545b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.247662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e302ad0-7c8e-4802-bf7c-67e8db72545b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.248256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e302ad0-7c8e-4802-bf7c-67e8db72545b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:54.250190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e302ad0-7c8e-4802-bf7c-67e8db72545b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:54.285827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1150/2271] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:54 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:54.293325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481216-4dfa-48f3-a7d6-57186e2e9ff3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:54.340499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481216-4dfa-48f3-a7d6-57186e2e9ff3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:54.443717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b0f68-f4b7-4fb8-b523-044e08d03a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:54.444505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b0f68-f4b7-4fb8-b523-044e08d03a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.444793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b0f68-f4b7-4fb8-b523-044e08d03a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.445221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b0f68-f4b7-4fb8-b523-044e08d03a89 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.445804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b0f68-f4b7-4fb8-b523-044e08d03a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:54.447891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b0f68-f4b7-4fb8-b523-044e08d03a89 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:54.523793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1122/2272] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:54 2022] POST /identity/v3/users => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:00:54.532753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e302ad0-7c8e-4802-bf7c-67e8db72545b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:54.553998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e302ad0-7c8e-4802-bf7c-67e8db72545b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:54.560192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57c715-457b-4573-8244-f161ffbf7c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:54.561024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57c715-457b-4573-8244-f161ffbf7c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.561450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57c715-457b-4573-8244-f161ffbf7c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.561872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57c715-457b-4573-8244-f161ffbf7c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.562861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57c715-457b-4573-8244-f161ffbf7c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:54.565064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57c715-457b-4573-8244-f161ffbf7c33 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:54.579569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1151/2273] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:54.589972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b0f68-f4b7-4fb8-b523-044e08d03a89 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:54.605200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b0f68-f4b7-4fb8-b523-044e08d03a89 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:54.613493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32a7bf-310e-4743-af0c-a63281f8fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:54.614764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32a7bf-310e-4743-af0c-a63281f8fc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.615258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32a7bf-310e-4743-af0c-a63281f8fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.616299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32a7bf-310e-4743-af0c-a63281f8fc3c admin admin] PATH_INFO: `/v3/projects/e63e6e6e02c6429c80202541e6c5c20d/users/6cc1e6a19e434861885f008cdeaf004e/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.624041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:54.643634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32a7bf-310e-4743-af0c-a63281f8fc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63e6e6e02c6429c80202541e6c5c20d, user_id=6cc1e6a19e434861885f008cdeaf004e, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:54.648306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32a7bf-310e-4743-af0c-a63281f8fc3c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:54.675460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1123/2274] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:54 2022] PUT /identity/v3/projects/e63e6e6e02c6429c80202541e6c5c20d/users/6cc1e6a19e434861885f008cdeaf004e/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:54.679445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57c715-457b-4573-8244-f161ffbf7c33 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:54.693101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57c715-457b-4573-8244-f161ffbf7c33 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:54.786707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:54.801746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e9e2d-a28d-4bd7-9130-c21745e5196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:54.802516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9e2d-a28d-4bd7-9130-c21745e5196a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.802800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9e2d-a28d-4bd7-9130-c21745e5196a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.809696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e9e2d-a28d-4bd7-9130-c21745e5196a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.809696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e9e2d-a28d-4bd7-9130-c21745e5196a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:54.811232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e9e2d-a28d-4bd7-9130-c21745e5196a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:54.844748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1152/2275] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:54.846132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32a7bf-310e-4743-af0c-a63281f8fc3c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:54.861683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32a7bf-310e-4743-af0c-a63281f8fc3c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:54.876253 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:54.876954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.878327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.878615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] PATH_INFO: `/v3/projects/e63e6e6e02c6429c80202541e6c5c20d/users/6cc1e6a19e434861885f008cdeaf004e/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.885056 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63e6e6e02c6429c80202541e6c5c20d, user_id=6cc1e6a19e434861885f008cdeaf004e, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:54.891767 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:54.915684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1124/2276] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:54 2022] PUT /identity/v3/projects/e63e6e6e02c6429c80202541e6c5c20d/users/6cc1e6a19e434861885f008cdeaf004e/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:54.926731 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85433c5-65a3-4cc8-8d7a-e26387c52b4a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:54.926927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85433c5-65a3-4cc8-8d7a-e26387c52b4a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:54.927163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85433c5-65a3-4cc8-8d7a-e26387c52b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:54.990292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a85433c5-65a3-4cc8-8d7a-e26387c52b4a None None] MFA Rules not processed for user `6cc1e6a19e434861885f008cdeaf004e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:54.994632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a85433c5-65a3-4cc8-8d7a-e26387c52b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:55.183798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1153/2277] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:55.196325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:55.198421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:55.327031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75533e-70a2-44f9-9644-5180936e4ee9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:55.341065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:55.343225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:55.345913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:55.346684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:55.489381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:55.492852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:55.513644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1125/2278] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:57.353877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85433c5-65a3-4cc8-8d7a-e26387c52b4a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:57.369927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85433c5-65a3-4cc8-8d7a-e26387c52b4a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:57.375744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90c207-7528-40ca-b337-0cc51213fedc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:57.376375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c207-7528-40ca-b337-0cc51213fedc service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:57.376808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c207-7528-40ca-b337-0cc51213fedc service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:57.377119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90c207-7528-40ca-b337-0cc51213fedc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:57.441436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90c207-7528-40ca-b337-0cc51213fedc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:57.442890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90c207-7528-40ca-b337-0cc51213fedc service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:57.454755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1154/2279] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:58.445948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:58.447367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:58.467051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba85646-c0c9-42aa-bda4-b99a27223ca7 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:58.478597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:58.479823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:58.480285 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:58.480736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:58.507913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:58.510216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:58.524015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1126/2280] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:00:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:00:58.938129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5141-a7fe-428b-8d6f-0d4ac863e8ae None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:58.938692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5141-a7fe-428b-8d6f-0d4ac863e8ae None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:58.938692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5141-a7fe-428b-8d6f-0d4ac863e8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:58.982350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-560b5141-a7fe-428b-8d6f-0d4ac863e8ae None None] MFA Rules not processed for user `f61f3182cb9d48d0ba6f417e2afb0809`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:00:58.983573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-560b5141-a7fe-428b-8d6f-0d4ac863e8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:59.080209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1155/2281] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:00:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:00:59.085826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:59.087833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:59.173480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862da102-c0e2-4b66-bfd2-45bb8539dc07 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:59.181380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946be2a-f3db-4a20-bbf1-478aa3d4f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:59.182017 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946be2a-f3db-4a20-bbf1-478aa3d4f2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.182475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946be2a-f3db-4a20-bbf1-478aa3d4f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.182755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946be2a-f3db-4a20-bbf1-478aa3d4f2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.183662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946be2a-f3db-4a20-bbf1-478aa3d4f2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:59.186071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946be2a-f3db-4a20-bbf1-478aa3d4f2d0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:59.221905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:59.233882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1127/2282] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:00:59 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:59.237672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b5141-a7fe-428b-8d6f-0d4ac863e8ae None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:59.257723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:00:59.262064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b5141-a7fe-428b-8d6f-0d4ac863e8ae None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:59.346187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe5c3b-c37a-4328-8789-9b13d8f8fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:59.346808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5c3b-c37a-4328-8789-9b13d8f8fdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.347090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5c3b-c37a-4328-8789-9b13d8f8fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.347367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5c3b-c37a-4328-8789-9b13d8f8fdb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.348034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe5c3b-c37a-4328-8789-9b13d8f8fdb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:59.350001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe5c3b-c37a-4328-8789-9b13d8f8fdb6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:59.383748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1156/2283] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:00:59 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:00:59.388379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946be2a-f3db-4a20-bbf1-478aa3d4f2d0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:59.400022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946be2a-f3db-4a20-bbf1-478aa3d4f2d0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:59.406921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc833-c87a-4f02-8678-f147cf6fca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:59.407561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc833-c87a-4f02-8678-f147cf6fca31 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.408003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc833-c87a-4f02-8678-f147cf6fca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.408279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fc833-c87a-4f02-8678-f147cf6fca31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.408951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fc833-c87a-4f02-8678-f147cf6fca31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:59.410666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fc833-c87a-4f02-8678-f147cf6fca31 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:59.426638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1128/2284] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:00:59.427948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe5c3b-c37a-4328-8789-9b13d8f8fdb6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:59.438924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe5c3b-c37a-4328-8789-9b13d8f8fdb6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:59.446974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af875-5cc1-48b0-824d-fa6c58434daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:59.448463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af875-5cc1-48b0-824d-fa6c58434daa admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.449037 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af875-5cc1-48b0-824d-fa6c58434daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.449588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8af875-5cc1-48b0-824d-fa6c58434daa admin admin] PATH_INFO: `/v3/projects/5f098a73bfb14061addc4fbf1025f5cb/users/ce1be25f669340b6b386384ee8970778/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.471096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8af875-5cc1-48b0-824d-fa6c58434daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f098a73bfb14061addc4fbf1025f5cb, user_id=ce1be25f669340b6b386384ee8970778, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:59.474164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8af875-5cc1-48b0-824d-fa6c58434daa admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:59.515878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1157/2285] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:59 2022] PUT /identity/v3/projects/5f098a73bfb14061addc4fbf1025f5cb/users/ce1be25f669340b6b386384ee8970778/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:59.517015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc833-c87a-4f02-8678-f147cf6fca31 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:59.534470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fc833-c87a-4f02-8678-f147cf6fca31 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:59.608477 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:59.609121 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.609402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.609672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.610316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:59.611955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:59.622024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1129/2286] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:00:59.626135 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af875-5cc1-48b0-824d-fa6c58434daa admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:59.640807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8af875-5cc1-48b0-824d-fa6c58434daa admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:59.646154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cc6df-a545-4bf2-9db3-3fefc0042fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:59.646929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc6df-a545-4bf2-9db3-3fefc0042fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.647873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc6df-a545-4bf2-9db3-3fefc0042fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.648217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cc6df-a545-4bf2-9db3-3fefc0042fe1 admin admin] PATH_INFO: `/v3/projects/5f098a73bfb14061addc4fbf1025f5cb/users/ce1be25f669340b6b386384ee8970778/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.650633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc6df-a545-4bf2-9db3-3fefc0042fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f098a73bfb14061addc4fbf1025f5cb, user_id=ce1be25f669340b6b386384ee8970778, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:59.653551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cc6df-a545-4bf2-9db3-3fefc0042fe1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:00:59.665335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1158/2287] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:00:59 2022] PUT /identity/v3/projects/5f098a73bfb14061addc4fbf1025f5cb/users/ce1be25f669340b6b386384ee8970778/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:00:59.715683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:00:59.717692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:00:59.736883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19081dd-5b7c-411b-90f5-12c9628468a8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:00:59.879858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:00:59.880514 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:00:59.880799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:00:59.881186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] PATH_INFO: `/v3/users/2e52a7eb847544e9b737ad1fb028e574` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:00:59.883149 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e52a7eb847544e9b737ad1fb028e574)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:00:59.885931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:00.192499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e52a7eb847544e9b737ad1fb028e574'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:00.217267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e52a7eb847544e9b737ad1fb028e574'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:00.219792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e52a7eb847544e9b737ad1fb028e574'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:00.235930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e52a7eb847544e9b737ad1fb028e574'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:00.242509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e52a7eb847544e9b737ad1fb028e574'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:00.278425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1130/2288] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:00:59 2022] DELETE /identity/v3/users/2e52a7eb847544e9b737ad1fb028e574 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:01:00.282551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da7d9-7dc0-45bc-8700-7bbfe975e70c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:00.283680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da7d9-7dc0-45bc-8700-7bbfe975e70c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:00.283680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da7d9-7dc0-45bc-8700-7bbfe975e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:00.327819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-702da7d9-7dc0-45bc-8700-7bbfe975e70c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:00.329015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-702da7d9-7dc0-45bc-8700-7bbfe975e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:00.439163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1159/2289] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:00.450819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:00.452776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:00.473011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:00.561110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7b6cf-d5ad-456d-bb26-8d0f2766df3a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:00.569095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf73e2-01c8-4bd2-ba78-7537975dc021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:00.569717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf73e2-01c8-4bd2-ba78-7537975dc021 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:00.570151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf73e2-01c8-4bd2-ba78-7537975dc021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:00.570664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf73e2-01c8-4bd2-ba78-7537975dc021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:00.586052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf73e2-01c8-4bd2-ba78-7537975dc021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:00.587784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf73e2-01c8-4bd2-ba78-7537975dc021 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:00.602287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1131/2290] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:01.003010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702da7d9-7dc0-45bc-8700-7bbfe975e70c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:01.006527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-702da7d9-7dc0-45bc-8700-7bbfe975e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:01.033308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702da7d9-7dc0-45bc-8700-7bbfe975e70c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:01.056504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:01.057330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:01.057724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:01.058107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] PATH_INFO: `/v3/projects/1dae4eee791444f5a03c4e739293bd14` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:01.059497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dae4eee791444f5a03c4e739293bd14)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:01.061868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:01.132391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dae4eee791444f5a03c4e739293bd14', 'request_id': 'req-f7e2d25d-84ed-4ec4-8a24-04864bf48870'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:01.134519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:01.146287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dae4eee791444f5a03c4e739293bd14', 'request_id': 'req-f7e2d25d-84ed-4ec4-8a24-04864bf48870'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:01.164144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dae4eee791444f5a03c4e739293bd14', 'request_id': 'req-f7e2d25d-84ed-4ec4-8a24-04864bf48870'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:01.195565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] The token cache is being invalidate because project 1dae4eee791444f5a03c4e739293bd14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:01.197234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:01.201375 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f7e2d25d-84ed-4ec4-8a24-04864bf48870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:01.204524 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1160/2291] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:01 2022] DELETE /identity/v3/projects/1dae4eee791444f5a03c4e739293bd14 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:01.210366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca815d5-e5eb-47ad-b4a0-9756ab8ffefc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:01.210930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca815d5-e5eb-47ad-b4a0-9756ab8ffefc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:01.211400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca815d5-e5eb-47ad-b4a0-9756ab8ffefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:01.236826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fca815d5-e5eb-47ad-b4a0-9756ab8ffefc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:01.238428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fca815d5-e5eb-47ad-b4a0-9756ab8ffefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:01.399166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1132/2292] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:01.407558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6d30-9df4-49c3-8ec3-732e6fd75a68 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:01.409761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6d30-9df4-49c3-8ec3-732e6fd75a68 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:01.410276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df6d30-9df4-49c3-8ec3-732e6fd75a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:01.449264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a8df6d30-9df4-49c3-8ec3-732e6fd75a68 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:01.453212 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a8df6d30-9df4-49c3-8ec3-732e6fd75a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:01.478269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1161/2293] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:01.479854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca815d5-e5eb-47ad-b4a0-9756ab8ffefc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:01.495306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca815d5-e5eb-47ad-b4a0-9756ab8ffefc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:01.528133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:01.528847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:01.529161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:01.529440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:01.530267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:01:01.530574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:01.532616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:01.552859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1133/2294] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:01:01.558012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df6d30-9df4-49c3-8ec3-732e6fd75a68 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:01.574894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df6d30-9df4-49c3-8ec3-732e6fd75a68 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:01.589810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eef978-0abd-492c-a664-2c5124ccae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:01.591116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eef978-0abd-492c-a664-2c5124ccae2d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:01.593200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eef978-0abd-492c-a664-2c5124ccae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:01.593669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eef978-0abd-492c-a664-2c5124ccae2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:01.594361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eef978-0abd-492c-a664-2c5124ccae2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:01.597446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eef978-0abd-492c-a664-2c5124ccae2d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:01.656792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1162/2295] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:01:01 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:01.659375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:01.681010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffc829-b6e1-4c55-a998-e3ac40fc66d1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:01.793610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd9350-e7ae-4d7c-84fe-47397a00ba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:01.794245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd9350-e7ae-4d7c-84fe-47397a00ba37 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:01.794761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd9350-e7ae-4d7c-84fe-47397a00ba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:01.795177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd9350-e7ae-4d7c-84fe-47397a00ba37 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:01.795830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd9350-e7ae-4d7c-84fe-47397a00ba37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:01.797887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd9350-e7ae-4d7c-84fe-47397a00ba37 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:01.841671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1134/2296] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:01:01 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:01.846851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eef978-0abd-492c-a664-2c5124ccae2d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:01.868537 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eef978-0abd-492c-a664-2c5124ccae2d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:01.881618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70923901-89bf-4822-a293-a7c56fdaa27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:01.883081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923901-89bf-4822-a293-a7c56fdaa27e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:01.883198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923901-89bf-4822-a293-a7c56fdaa27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:01.883641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70923901-89bf-4822-a293-a7c56fdaa27e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:01.884507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923901-89bf-4822-a293-a7c56fdaa27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:01.887085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70923901-89bf-4822-a293-a7c56fdaa27e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:01.908017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1163/2297] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:01:01.909499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd9350-e7ae-4d7c-84fe-47397a00ba37 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:01.933882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd9350-e7ae-4d7c-84fe-47397a00ba37 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:01.944867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76477f3-2055-4590-8d3d-45bb7ba057ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:01.945631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76477f3-2055-4590-8d3d-45bb7ba057ee admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:01.945923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76477f3-2055-4590-8d3d-45bb7ba057ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:01.946277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76477f3-2055-4590-8d3d-45bb7ba057ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:01.946939 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76477f3-2055-4590-8d3d-45bb7ba057ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:01.948645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76477f3-2055-4590-8d3d-45bb7ba057ee admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:01.965028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1135/2298] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:01:01.966431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70923901-89bf-4822-a293-a7c56fdaa27e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:01.981836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70923901-89bf-4822-a293-a7c56fdaa27e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:02.000879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378672a-a87a-460d-905d-431834a87deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:02.001596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378672a-a87a-460d-905d-431834a87deb admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:02.001878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378672a-a87a-460d-905d-431834a87deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:02.002159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378672a-a87a-460d-905d-431834a87deb admin admin] PATH_INFO: `/v3/projects/95a4d844b20f4ed895df7947f6e2ff24/users/c6c5ac9b1bb644d687343e8d551603a4/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:02.045161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378672a-a87a-460d-905d-431834a87deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a4d844b20f4ed895df7947f6e2ff24, user_id=c6c5ac9b1bb644d687343e8d551603a4, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:02.047853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378672a-a87a-460d-905d-431834a87deb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:02.063348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1164/2299] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:01:01 2022] PUT /identity/v3/projects/95a4d844b20f4ed895df7947f6e2ff24/users/c6c5ac9b1bb644d687343e8d551603a4/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:02.078955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f15e8-54a7-4255-ba28-751e029a39fc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:02.079648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f15e8-54a7-4255-ba28-751e029a39fc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:02.080354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f15e8-54a7-4255-ba28-751e029a39fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:02.122948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:02.167481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3e7f15e8-54a7-4255-ba28-751e029a39fc None None] MFA Rules not processed for user `c6c5ac9b1bb644d687343e8d551603a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:02.167481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3e7f15e8-54a7-4255-ba28-751e029a39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:02.290867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1136/2300] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:02.291660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378672a-a87a-460d-905d-431834a87deb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:02.379532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378672a-a87a-460d-905d-431834a87deb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:02.386372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672944a1-2ec3-462e-b8e0-fa6ea1efa7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:02.387110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672944a1-2ec3-462e-b8e0-fa6ea1efa7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:02.387392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672944a1-2ec3-462e-b8e0-fa6ea1efa7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:02.387761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672944a1-2ec3-462e-b8e0-fa6ea1efa7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:02.388894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672944a1-2ec3-462e-b8e0-fa6ea1efa7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:02.391855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672944a1-2ec3-462e-b8e0-fa6ea1efa7b0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:02.479228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1165/2301] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:01:02 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:01:02.482509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f15e8-54a7-4255-ba28-751e029a39fc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:02.510935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f15e8-54a7-4255-ba28-751e029a39fc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:02.641060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68102d-f7d6-4543-a1b9-5b6e518948f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:02.641829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68102d-f7d6-4543-a1b9-5b6e518948f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:02.642191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68102d-f7d6-4543-a1b9-5b6e518948f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:02.642544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68102d-f7d6-4543-a1b9-5b6e518948f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:02.643295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68102d-f7d6-4543-a1b9-5b6e518948f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:02.645724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68102d-f7d6-4543-a1b9-5b6e518948f8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:02.697837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1137/2302] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:01:02 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:02.699347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672944a1-2ec3-462e-b8e0-fa6ea1efa7b0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:02.721711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672944a1-2ec3-462e-b8e0-fa6ea1efa7b0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:02.735053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625d5bc-830b-437a-9c6f-e8f3e2a70104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:02.735702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625d5bc-830b-437a-9c6f-e8f3e2a70104 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:02.736494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625d5bc-830b-437a-9c6f-e8f3e2a70104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:02.736781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625d5bc-830b-437a-9c6f-e8f3e2a70104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:02.738820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625d5bc-830b-437a-9c6f-e8f3e2a70104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:02.741998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625d5bc-830b-437a-9c6f-e8f3e2a70104 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:02.766831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1166/2303] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:01:02.771005 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68102d-f7d6-4543-a1b9-5b6e518948f8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:02.784652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68102d-f7d6-4543-a1b9-5b6e518948f8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:02.806001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb083a9-f452-4798-92dc-d99e955f0e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:02.806649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb083a9-f452-4798-92dc-d99e955f0e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:02.807000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb083a9-f452-4798-92dc-d99e955f0e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:02.807190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb083a9-f452-4798-92dc-d99e955f0e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:02.807852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb083a9-f452-4798-92dc-d99e955f0e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:02.809519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb083a9-f452-4798-92dc-d99e955f0e21 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:02.828631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1138/2304] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:01:02.835563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625d5bc-830b-437a-9c6f-e8f3e2a70104 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:02.848278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625d5bc-830b-437a-9c6f-e8f3e2a70104 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:02.861329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04437d-7cec-41ef-a8a3-a210f187a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:02.862038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04437d-7cec-41ef-a8a3-a210f187a175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:02.862311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04437d-7cec-41ef-a8a3-a210f187a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:02.862587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04437d-7cec-41ef-a8a3-a210f187a175 admin admin] PATH_INFO: `/v3/projects/3bbaa3e01f4d4076940d93f230f20be0/users/d621b38ecde641b296c9863cd7c399cc/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:02.931767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04437d-7cec-41ef-a8a3-a210f187a175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbaa3e01f4d4076940d93f230f20be0, user_id=d621b38ecde641b296c9863cd7c399cc, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:02.936213 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04437d-7cec-41ef-a8a3-a210f187a175 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:02.972820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1167/2305] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:01:02 2022] PUT /identity/v3/projects/3bbaa3e01f4d4076940d93f230f20be0/users/d621b38ecde641b296c9863cd7c399cc/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:02.984604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040054-1b8d-46f9-8264-ade5b7b311a2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:02.988569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040054-1b8d-46f9-8264-ade5b7b311a2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:02.988863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040054-1b8d-46f9-8264-ade5b7b311a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.062186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4f040054-1b8d-46f9-8264-ade5b7b311a2 None None] MFA Rules not processed for user `d621b38ecde641b296c9863cd7c399cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:03.064452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4f040054-1b8d-46f9-8264-ade5b7b311a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:03.239161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1139/2306] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:03.244301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04437d-7cec-41ef-a8a3-a210f187a175 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:03.362074 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:03.390595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040054-1b8d-46f9-8264-ade5b7b311a2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:03.392151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4f040054-1b8d-46f9-8264-ade5b7b311a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:03.424260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:03.466840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04437d-7cec-41ef-a8a3-a210f187a175 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:03.477704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1255e-59af-4e6e-8a9b-66528fabc945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:03.478721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1255e-59af-4e6e-8a9b-66528fabc945 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.479351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1255e-59af-4e6e-8a9b-66528fabc945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.480759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1255e-59af-4e6e-8a9b-66528fabc945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.481971 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1255e-59af-4e6e-8a9b-66528fabc945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:03.484937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1255e-59af-4e6e-8a9b-66528fabc945 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:03.539553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1168/2307] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:01:03 2022] POST /identity/v3/projects => generated 375 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:03.540837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1255e-59af-4e6e-8a9b-66528fabc945 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:03.582347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040054-1b8d-46f9-8264-ade5b7b311a2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:03.662306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1255e-59af-4e6e-8a9b-66528fabc945 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:03.671029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d10e57-6b9a-4df7-af7c-a4e174f171b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:03.671665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d10e57-6b9a-4df7-af7c-a4e174f171b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.672080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d10e57-6b9a-4df7-af7c-a4e174f171b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.672488 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d10e57-6b9a-4df7-af7c-a4e174f171b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.673401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d10e57-6b9a-4df7-af7c-a4e174f171b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:03.678809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d10e57-6b9a-4df7-af7c-a4e174f171b0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:03.687002 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:03.687661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.687941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.688210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] PATH_INFO: `/v3/users/f9377f97c7dd465b8dd9d75488bd042b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.689548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9377f97c7dd465b8dd9d75488bd042b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:03.691456 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:03.708060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1169/2308] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:01:03 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:03.713446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d10e57-6b9a-4df7-af7c-a4e174f171b0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:03.724741 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d10e57-6b9a-4df7-af7c-a4e174f171b0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:03.730555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49e2dc-7d83-4a4a-bd92-5e17bff8c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:03.731178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49e2dc-7d83-4a4a-bd92-5e17bff8c47e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.731566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49e2dc-7d83-4a4a-bd92-5e17bff8c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.731925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49e2dc-7d83-4a4a-bd92-5e17bff8c47e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.733139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49e2dc-7d83-4a4a-bd92-5e17bff8c47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:03.734925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49e2dc-7d83-4a4a-bd92-5e17bff8c47e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:03.751818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1170/2309] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:01:03.753280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49e2dc-7d83-4a4a-bd92-5e17bff8c47e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:03.765462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49e2dc-7d83-4a4a-bd92-5e17bff8c47e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:03.780779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ba5bf-3d1c-4bcd-8269-413a640aa616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:03.781582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba5bf-3d1c-4bcd-8269-413a640aa616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.782008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba5bf-3d1c-4bcd-8269-413a640aa616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.782293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ba5bf-3d1c-4bcd-8269-413a640aa616 admin admin] PATH_INFO: `/v3/projects/337ee655466c4fc8a31acd7ec63f58ea/users/21e48cdffebf4ed483a100bacbb5183a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.811181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ba5bf-3d1c-4bcd-8269-413a640aa616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337ee655466c4fc8a31acd7ec63f58ea, user_id=21e48cdffebf4ed483a100bacbb5183a, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:03.814883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ba5bf-3d1c-4bcd-8269-413a640aa616 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:03.837797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9377f97c7dd465b8dd9d75488bd042b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:03.846351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1171/2310] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:01:03 2022] PUT /identity/v3/projects/337ee655466c4fc8a31acd7ec63f58ea/users/21e48cdffebf4ed483a100bacbb5183a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:03.855301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ba5bf-3d1c-4bcd-8269-413a640aa616 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:03.856922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9377f97c7dd465b8dd9d75488bd042b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:03.857913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9377f97c7dd465b8dd9d75488bd042b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:03.883177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9377f97c7dd465b8dd9d75488bd042b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:03.884214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad3041c-b1d9-4752-86f8-53e30db1ae99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9377f97c7dd465b8dd9d75488bd042b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:03.941879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1140/2311] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:03 2022] DELETE /identity/v3/users/f9377f97c7dd465b8dd9d75488bd042b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:03.943383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f79a-bb73-4908-86c9-49b76a53f451 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:03.944397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f79a-bb73-4908-86c9-49b76a53f451 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:03.947845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525f79a-bb73-4908-86c9-49b76a53f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:03.956130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ba5bf-3d1c-4bcd-8269-413a640aa616 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:03.975633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:03.988033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d525f79a-bb73-4908-86c9-49b76a53f451 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:03.989496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d525f79a-bb73-4908-86c9-49b76a53f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:04.042160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:04.042855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:04.043068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:04.043344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:04.043993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:04.045660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:04.059183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1172/2312] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:01:04.063135 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:04.064960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:04.077397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:04.081387 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55794d4-88fb-4d4b-8cbd-c9ca051236a0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:04.092340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbd7d8-1e0c-4503-afa1-dfd5327172c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:04.095699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd7d8-1e0c-4503-afa1-dfd5327172c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:04.095989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd7d8-1e0c-4503-afa1-dfd5327172c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:04.096280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd7d8-1e0c-4503-afa1-dfd5327172c9 admin admin] PATH_INFO: `/v3/projects/337ee655466c4fc8a31acd7ec63f58ea/users/21e48cdffebf4ed483a100bacbb5183a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:04.099036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbd7d8-1e0c-4503-afa1-dfd5327172c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337ee655466c4fc8a31acd7ec63f58ea, user_id=21e48cdffebf4ed483a100bacbb5183a, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:04.103941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbd7d8-1e0c-4503-afa1-dfd5327172c9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:04.138762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1173/2313] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:01:04 2022] PUT /identity/v3/projects/337ee655466c4fc8a31acd7ec63f58ea/users/21e48cdffebf4ed483a100bacbb5183a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:04.141506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb731-35a4-45e2-9ec9-6373592e89b3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:04.141803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb731-35a4-45e2-9ec9-6373592e89b3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:04.142092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fb731-35a4-45e2-9ec9-6373592e89b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:04.163512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1141/2314] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:04.193982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f79a-bb73-4908-86c9-49b76a53f451 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:04.198798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d525f79a-bb73-4908-86c9-49b76a53f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:04.217730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-431fb731-35a4-45e2-9ec9-6373592e89b3 None None] MFA Rules not processed for user `21e48cdffebf4ed483a100bacbb5183a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:04.222342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-431fb731-35a4-45e2-9ec9-6373592e89b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:04.338165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525f79a-bb73-4908-86c9-49b76a53f451 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:04.364405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1174/2315] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:04.390264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fb731-35a4-45e2-9ec9-6373592e89b3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:04.391849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-431fb731-35a4-45e2-9ec9-6373592e89b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:04.475495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:04.476630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:04.479481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:04.479719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:04.516739 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fb731-35a4-45e2-9ec9-6373592e89b3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:04.527917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:04.528560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:04.528842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:04.529152 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:04.532517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:04.608659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:04.613335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:04.615096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:04.629985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1142/2316] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:04.701907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:04.704184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:04.744897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1175/2317] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:05.421561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:05.422743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:05.445997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a3541-154c-41cb-b4c0-3ca1e8d41653 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:05.452545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:05.453241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:05.453530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:05.453794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] PATH_INFO: `/v3/projects/d95bc34300874ae1bd43d20d7ffa4412` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:05.454952 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95bc34300874ae1bd43d20d7ffa4412)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:05.457031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:05.519196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:05.531428 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95bc34300874ae1bd43d20d7ffa4412', 'request_id': 'req-0b75808a-ed80-4010-8f78-999238bbcba4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.542424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95bc34300874ae1bd43d20d7ffa4412', 'request_id': 'req-0b75808a-ed80-4010-8f78-999238bbcba4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.552125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95bc34300874ae1bd43d20d7ffa4412', 'request_id': 'req-0b75808a-ed80-4010-8f78-999238bbcba4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.569914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] The token cache is being invalidate because project d95bc34300874ae1bd43d20d7ffa4412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:05.570214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.571155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.574549 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1143/2318] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:05 2022] DELETE /identity/v3/projects/d95bc34300874ae1bd43d20d7ffa4412 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:05.579732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:05.592554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264680f-69aa-423b-a931-37c5adcbfb8b service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:05.686333 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:05.687364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:05.687946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:05.688406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] PATH_INFO: `/v3/users/ed06b6d21d65460bad760473d7a8cf88` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:05.690540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed06b6d21d65460bad760473d7a8cf88)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:05.694187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:05.753290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed06b6d21d65460bad760473d7a8cf88'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.768818 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed06b6d21d65460bad760473d7a8cf88'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.769589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed06b6d21d65460bad760473d7a8cf88'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.778529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed06b6d21d65460bad760473d7a8cf88'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.779176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed06b6d21d65460bad760473d7a8cf88'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:05.793155 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1176/2319] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:05 2022] DELETE /identity/v3/users/ed06b6d21d65460bad760473d7a8cf88 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:06.387312 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:06.389678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:06.407334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75808a-ed80-4010-8f78-999238bbcba4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:06.532480 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:06.533303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:06.534048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:06.534562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] PATH_INFO: `/v3/projects/3d8934d98ba445d7ab63937f37117614` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:06.536495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8934d98ba445d7ab63937f37117614)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:06.541356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:06.573678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:06.575747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:06.697152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8934d98ba445d7ab63937f37117614', 'request_id': 'req-9975399c-ebd5-4621-a1de-7fdb7a00ced3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:06.720214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8934d98ba445d7ab63937f37117614', 'request_id': 'req-9975399c-ebd5-4621-a1de-7fdb7a00ced3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:06.730570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8934d98ba445d7ab63937f37117614', 'request_id': 'req-9975399c-ebd5-4621-a1de-7fdb7a00ced3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:06.764117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] The token cache is being invalidate because project 3d8934d98ba445d7ab63937f37117614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:06.764423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:06.765644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:06.770699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1144/2320] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:06 2022] DELETE /identity/v3/projects/3d8934d98ba445d7ab63937f37117614 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:06.776389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:06.778822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:06.783530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b9f61-01a9-4d96-b4e5-0219b791bb04 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:06.854479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:07.006215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c1ca2-248d-4782-81ad-361dea3b9ad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:07.007281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c1ca2-248d-4782-81ad-361dea3b9ad5 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:07.007737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c1ca2-248d-4782-81ad-361dea3b9ad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:07.008225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c1ca2-248d-4782-81ad-361dea3b9ad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:07.010796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-018c1ca2-248d-4782-81ad-361dea3b9ad5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:07.012884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:07.021871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975399c-ebd5-4621-a1de-7fdb7a00ced3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:07.029806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:07.030843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:07.031328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:07.032159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] PATH_INFO: `/v3/users/6cc1e6a19e434861885f008cdeaf004e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:07.034379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc1e6a19e434861885f008cdeaf004e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:07.038690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:07.220355 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc1e6a19e434861885f008cdeaf004e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:07.242997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c1ca2-248d-4782-81ad-361dea3b9ad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:07.244469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c1ca2-248d-4782-81ad-361dea3b9ad5 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:07.255661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc1e6a19e434861885f008cdeaf004e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:07.257327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc1e6a19e434861885f008cdeaf004e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:07.282580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc1e6a19e434861885f008cdeaf004e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:07.282580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc1e6a19e434861885f008cdeaf004e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:07.300855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1177/2321] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:07.336713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1145/2322] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:06 2022] DELETE /identity/v3/users/6cc1e6a19e434861885f008cdeaf004e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:07.536281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88baa4b-512d-4e1c-8ff9-a3beb7f3836b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:07.536705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88baa4b-512d-4e1c-8ff9-a3beb7f3836b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:07.537281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88baa4b-512d-4e1c-8ff9-a3beb7f3836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:07.637258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d88baa4b-512d-4e1c-8ff9-a3beb7f3836b None None] MFA Rules not processed for user `ce1be25f669340b6b386384ee8970778`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:07.638792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d88baa4b-512d-4e1c-8ff9-a3beb7f3836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:07.802260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1178/2323] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:07.878683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:07.880386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:07.907534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88baa4b-512d-4e1c-8ff9-a3beb7f3836b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:07.909441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d88baa4b-512d-4e1c-8ff9-a3beb7f3836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:07.967716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9e0e-c2aa-4f20-ba40-ef34561cebc0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:07.972626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82ae5f-90f6-4f8f-87e7-15eb53bc0599 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:07.973643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82ae5f-90f6-4f8f-87e7-15eb53bc0599 service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:07.973992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82ae5f-90f6-4f8f-87e7-15eb53bc0599 service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:07.974386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82ae5f-90f6-4f8f-87e7-15eb53bc0599 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:07.977178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ed82ae5f-90f6-4f8f-87e7-15eb53bc0599 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:08.024878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:08.051942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88baa4b-512d-4e1c-8ff9-a3beb7f3836b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:08.060134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:08.060771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:08.061078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:08.061415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] PATH_INFO: `/v3/projects/e63e6e6e02c6429c80202541e6c5c20d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:08.062549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63e6e6e02c6429c80202541e6c5c20d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:08.064537 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:08.068714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82ae5f-90f6-4f8f-87e7-15eb53bc0599 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:08.071868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82ae5f-90f6-4f8f-87e7-15eb53bc0599 service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:08.086886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1146/2324] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:01:08.121961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63e6e6e02c6429c80202541e6c5c20d', 'request_id': 'req-2e62daba-acc1-462b-9f08-588a73261b78'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:08.128723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63e6e6e02c6429c80202541e6c5c20d', 'request_id': 'req-2e62daba-acc1-462b-9f08-588a73261b78'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:08.135678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63e6e6e02c6429c80202541e6c5c20d', 'request_id': 'req-2e62daba-acc1-462b-9f08-588a73261b78'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:08.160131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] The token cache is being invalidate because project e63e6e6e02c6429c80202541e6c5c20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:08.160584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:08.161547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e62daba-acc1-462b-9f08-588a73261b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:08.165112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1179/2325] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:07 2022] DELETE /identity/v3/projects/e63e6e6e02c6429c80202541e6c5c20d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:08.169627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe829d0-79a2-4bf6-a8ff-763e5e42b2a7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:08.170106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe829d0-79a2-4bf6-a8ff-763e5e42b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:08.170668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe829d0-79a2-4bf6-a8ff-763e5e42b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:08.196377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-abe829d0-79a2-4bf6-a8ff-763e5e42b2a7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:08.197647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-abe829d0-79a2-4bf6-a8ff-763e5e42b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:08.242694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:08.310015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1147/2326] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:08.317581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3415b-946b-426a-8abe-dd495f2ecc6a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:08.318089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3415b-946b-426a-8abe-dd495f2ecc6a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:08.318624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3415b-946b-426a-8abe-dd495f2ecc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:08.344559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a68d-ccc0-4215-a11c-29297b7dabde None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:08.344962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a68d-ccc0-4215-a11c-29297b7dabde None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:08.345401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420a68d-ccc0-4215-a11c-29297b7dabde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:08.354218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-12a3415b-946b-426a-8abe-dd495f2ecc6a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:08.355529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-12a3415b-946b-426a-8abe-dd495f2ecc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:08.372697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1180/2327] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:08.374056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3415b-946b-426a-8abe-dd495f2ecc6a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:08.375629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-12a3415b-946b-426a-8abe-dd495f2ecc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:08.380025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2420a68d-ccc0-4215-a11c-29297b7dabde None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:08.381490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2420a68d-ccc0-4215-a11c-29297b7dabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:08.469905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1148/2328] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:01:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:08.476743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a68d-ccc0-4215-a11c-29297b7dabde None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:08.493976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3415b-946b-426a-8abe-dd495f2ecc6a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:08.502406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420a68d-ccc0-4215-a11c-29297b7dabde None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:08.506564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:08.508262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:08.508740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:08.509654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:08.513146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:08.516775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:08.517439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:08.517754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:08.518031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:08.519890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:01:08.519890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:08.522630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:08.554476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1149/2329] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:01:08.568200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:08.570213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:08.694136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:08.697971 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:08.737712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1181/2330] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:08.740171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:08.745751 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57073a-2cfc-4bb5-a128-fd41546b7377 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:08.751958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fb164-59f0-4d77-80c3-eb58f8b3577a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:08.752778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb164-59f0-4d77-80c3-eb58f8b3577a service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:08.753223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb164-59f0-4d77-80c3-eb58f8b3577a service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:08.753515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb164-59f0-4d77-80c3-eb58f8b3577a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:08.781103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba9d0-e1e0-4854-a486-9225180f372f service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:08.786626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fb164-59f0-4d77-80c3-eb58f8b3577a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:08.789289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fb164-59f0-4d77-80c3-eb58f8b3577a service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:08.801986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f2c26-3a1c-40aa-86b1-ca52f4a2ccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:08.802824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f2c26-3a1c-40aa-86b1-ca52f4a2ccae admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:08.804898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f2c26-3a1c-40aa-86b1-ca52f4a2ccae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:08.805431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f2c26-3a1c-40aa-86b1-ca52f4a2ccae admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:08.807094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f2c26-3a1c-40aa-86b1-ca52f4a2ccae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:08.810487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f2c26-3a1c-40aa-86b1-ca52f4a2ccae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:08.823315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1150/2331] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:01:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:01:08.881472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1182/2332] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:01:08 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:08.883507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fb164-59f0-4d77-80c3-eb58f8b3577a service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:08.904364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fb164-59f0-4d77-80c3-eb58f8b3577a service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:08.990622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:09.004212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecc550-4e76-42ac-8916-c3b3243bdb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:09.005430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecc550-4e76-42ac-8916-c3b3243bdb37 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.005726 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecc550-4e76-42ac-8916-c3b3243bdb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.006065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecc550-4e76-42ac-8916-c3b3243bdb37 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.006683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecc550-4e76-42ac-8916-c3b3243bdb37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:09.009259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecc550-4e76-42ac-8916-c3b3243bdb37 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:09.041319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1151/2333] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:01:08 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:09.042511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f2c26-3a1c-40aa-86b1-ca52f4a2ccae admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:09.050898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:09.064012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f2c26-3a1c-40aa-86b1-ca52f4a2ccae admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:09.076902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc51a9e-842a-4891-a251-c835227d887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:09.077793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc51a9e-842a-4891-a251-c835227d887b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.078077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc51a9e-842a-4891-a251-c835227d887b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.078355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc51a9e-842a-4891-a251-c835227d887b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.079012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc51a9e-842a-4891-a251-c835227d887b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:09.080800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc51a9e-842a-4891-a251-c835227d887b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:09.094533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1183/2334] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:01:09.098302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecc550-4e76-42ac-8916-c3b3243bdb37 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:09.109545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecc550-4e76-42ac-8916-c3b3243bdb37 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:09.114886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50b918-b75e-439b-bc51-24a558170a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:09.115583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b918-b75e-439b-bc51-24a558170a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.115864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b918-b75e-439b-bc51-24a558170a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.116130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b918-b75e-439b-bc51-24a558170a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.117368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50b918-b75e-439b-bc51-24a558170a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:09.119159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50b918-b75e-439b-bc51-24a558170a96 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:09.132722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1152/2335] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:01:09.137009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc51a9e-842a-4891-a251-c835227d887b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:09.158017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc51a9e-842a-4891-a251-c835227d887b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:09.168661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbcc0-1fd1-4075-b8a5-450b30bcd47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:09.168661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbcc0-1fd1-4075-b8a5-450b30bcd47d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.168918 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbcc0-1fd1-4075-b8a5-450b30bcd47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.169211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbcc0-1fd1-4075-b8a5-450b30bcd47d admin admin] PATH_INFO: `/v3/projects/fcbe68ce2783458a9ca6d698fcedfa54/users/40b48363834f4cbe8a52e6f7b661cd23/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.211793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdbcc0-1fd1-4075-b8a5-450b30bcd47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbe68ce2783458a9ca6d698fcedfa54, user_id=40b48363834f4cbe8a52e6f7b661cd23, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:09.214809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdbcc0-1fd1-4075-b8a5-450b30bcd47d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:09.238240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1184/2336] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:01:09 2022] PUT /identity/v3/projects/fcbe68ce2783458a9ca6d698fcedfa54/users/40b48363834f4cbe8a52e6f7b661cd23/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:09.249732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ddcd8-9438-4a7d-9551-579118c2a889 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.250025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ddcd8-9438-4a7d-9551-579118c2a889 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.250302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ddcd8-9438-4a7d-9551-579118c2a889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.290741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-216ddcd8-9438-4a7d-9551-579118c2a889 None None] MFA Rules not processed for user `40b48363834f4cbe8a52e6f7b661cd23`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:09.291979 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-216ddcd8-9438-4a7d-9551-579118c2a889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:09.414331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1153/2337] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:09.427399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbcc0-1fd1-4075-b8a5-450b30bcd47d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:09.570762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbcc0-1fd1-4075-b8a5-450b30bcd47d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:09.575050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df771-694d-4378-bd15-bfcf06f31961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:09.575942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df771-694d-4378-bd15-bfcf06f31961 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.576429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df771-694d-4378-bd15-bfcf06f31961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.576934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df771-694d-4378-bd15-bfcf06f31961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.592239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1df771-694d-4378-bd15-bfcf06f31961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:09.594542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1df771-694d-4378-bd15-bfcf06f31961 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:09.622982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1185/2338] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:09.654275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ddcd8-9438-4a7d-9551-579118c2a889 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:09.840009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ddcd8-9438-4a7d-9551-579118c2a889 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:09.849423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:09.850082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:09.850362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:09.850640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] PATH_INFO: `/v3/users/40b48363834f4cbe8a52e6f7b661cd23` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:09.854472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b48363834f4cbe8a52e6f7b661cd23)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:09.856433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:09.989710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b48363834f4cbe8a52e6f7b661cd23'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:10.016248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:10.021337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b48363834f4cbe8a52e6f7b661cd23'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:10.023092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b48363834f4cbe8a52e6f7b661cd23'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:10.068564 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b48363834f4cbe8a52e6f7b661cd23'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:10.069386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b48363834f4cbe8a52e6f7b661cd23'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:10.094568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1154/2339] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:09 2022] DELETE /identity/v3/users/40b48363834f4cbe8a52e6f7b661cd23 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:10.099346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef3c3-490d-4682-bb41-ba66996e0bec None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:10.099874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef3c3-490d-4682-bb41-ba66996e0bec None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:10.099874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef3c3-490d-4682-bb41-ba66996e0bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:10.155057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e73ef3c3-490d-4682-bb41-ba66996e0bec None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:10.159242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e73ef3c3-490d-4682-bb41-ba66996e0bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:10.420209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1186/2340] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:10.429278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:10.430903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:10.602661 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79756a1d-1c9b-4809-9f59-b3f45e5d4934 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:10.621724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:10.622459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:10.623576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:10.623762 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:10.646043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:10.650117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:10.678050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1155/2341] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:11.064944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef3c3-490d-4682-bb41-ba66996e0bec None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:11.066564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e73ef3c3-490d-4682-bb41-ba66996e0bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:11.080620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ef3c3-490d-4682-bb41-ba66996e0bec None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:11.110089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:11.110683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:11.110963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:11.111238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] PATH_INFO: `/v3/projects/fcbe68ce2783458a9ca6d698fcedfa54` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:11.112802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbe68ce2783458a9ca6d698fcedfa54)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:11.115470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:11.176207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbe68ce2783458a9ca6d698fcedfa54', 'request_id': 'req-b4037c52-71f2-4b93-bfdf-35ddadffbd24'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:11.183695 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbe68ce2783458a9ca6d698fcedfa54', 'request_id': 'req-b4037c52-71f2-4b93-bfdf-35ddadffbd24'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:11.198620 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbe68ce2783458a9ca6d698fcedfa54', 'request_id': 'req-b4037c52-71f2-4b93-bfdf-35ddadffbd24'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:11.203388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:11.229180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] The token cache is being invalidate because project fcbe68ce2783458a9ca6d698fcedfa54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:11.229725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:11.230836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4037c52-71f2-4b93-bfdf-35ddadffbd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:11.247061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1187/2342] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:11 2022] DELETE /identity/v3/projects/fcbe68ce2783458a9ca6d698fcedfa54 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:13.798363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:13.801331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:13.830138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d1a7a-eb9e-4f47-b28b-46abe58386dd service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:13.931944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:13.932705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:13.933082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:13.933435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] PATH_INFO: `/v3/users/c6c5ac9b1bb644d687343e8d551603a4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:13.934680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c5ac9b1bb644d687343e8d551603a4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:13.938600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:14.053200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c5ac9b1bb644d687343e8d551603a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:14.079900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c5ac9b1bb644d687343e8d551603a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:14.080862 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c5ac9b1bb644d687343e8d551603a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:14.097415 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c5ac9b1bb644d687343e8d551603a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:14.098049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c5ac9b1bb644d687343e8d551603a4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:14.134673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:14.162638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1156/2343] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:13 2022] DELETE /identity/v3/users/c6c5ac9b1bb644d687343e8d551603a4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:14.168111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341adf0e-3c2b-4039-a264-5ef44fa09408 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:14.168675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341adf0e-3c2b-4039-a264-5ef44fa09408 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:14.168862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341adf0e-3c2b-4039-a264-5ef44fa09408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:14.247426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-341adf0e-3c2b-4039-a264-5ef44fa09408 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:14.252659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-341adf0e-3c2b-4039-a264-5ef44fa09408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:14.410766 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1188/2344] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:14.417090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:14.418704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:14.635210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84e8f4-14f8-4241-99d2-22d575258742 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:14.644093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9ef13-8b9d-490e-b293-ec6bbf53aed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:14.646073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9ef13-8b9d-490e-b293-ec6bbf53aed4 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:14.646360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9ef13-8b9d-490e-b293-ec6bbf53aed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:14.646677 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9ef13-8b9d-490e-b293-ec6bbf53aed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:14.701187 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9ef13-8b9d-490e-b293-ec6bbf53aed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:14.702744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9ef13-8b9d-490e-b293-ec6bbf53aed4 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:14.727675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1157/2345] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:01:15.418898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341adf0e-3c2b-4039-a264-5ef44fa09408 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:15.420400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-341adf0e-3c2b-4039-a264-5ef44fa09408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:15.449681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341adf0e-3c2b-4039-a264-5ef44fa09408 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:15.455382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:15.456087 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:15.456369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:15.456651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] PATH_INFO: `/v3/projects/95a4d844b20f4ed895df7947f6e2ff24` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:15.457999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a4d844b20f4ed895df7947f6e2ff24)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:15.460086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:15.518868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a4d844b20f4ed895df7947f6e2ff24', 'request_id': 'req-f87e166d-f22b-4861-aa36-48a87f3d0f12'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.527038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a4d844b20f4ed895df7947f6e2ff24', 'request_id': 'req-f87e166d-f22b-4861-aa36-48a87f3d0f12'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.537157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a4d844b20f4ed895df7947f6e2ff24', 'request_id': 'req-f87e166d-f22b-4861-aa36-48a87f3d0f12'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.560077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] The token cache is being invalidate because project 95a4d844b20f4ed895df7947f6e2ff24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:15.562024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.562024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.563490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1189/2346] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:15 2022] DELETE /identity/v3/projects/95a4d844b20f4ed895df7947f6e2ff24 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:15.567532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9ef13-8b9d-490e-b293-ec6bbf53aed4 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:15.580311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9ef13-8b9d-490e-b293-ec6bbf53aed4 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:15.660795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:15.661847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:15.662311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:15.662913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] PATH_INFO: `/v3/users/d621b38ecde641b296c9863cd7c399cc` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:15.666120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d621b38ecde641b296c9863cd7c399cc)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:15.669011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:15.755167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd621b38ecde641b296c9863cd7c399cc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.773944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd621b38ecde641b296c9863cd7c399cc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.774760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd621b38ecde641b296c9863cd7c399cc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.786841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd621b38ecde641b296c9863cd7c399cc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.787502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd621b38ecde641b296c9863cd7c399cc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:15.816856 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1158/2347] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:15 2022] DELETE /identity/v3/users/d621b38ecde641b296c9863cd7c399cc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:16.358956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:16.360104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:16.388419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e166d-f22b-4861-aa36-48a87f3d0f12 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:16.537511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:16.540208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:16.540732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:16.541450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] PATH_INFO: `/v3/projects/3bbaa3e01f4d4076940d93f230f20be0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:16.543271 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbaa3e01f4d4076940d93f230f20be0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:16.545690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:16.573345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:16.616454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbaa3e01f4d4076940d93f230f20be0', 'request_id': 'req-246ecc56-7b6b-4319-85ee-6a19def2997d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.625933 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbaa3e01f4d4076940d93f230f20be0', 'request_id': 'req-246ecc56-7b6b-4319-85ee-6a19def2997d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.633481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbaa3e01f4d4076940d93f230f20be0', 'request_id': 'req-246ecc56-7b6b-4319-85ee-6a19def2997d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.662735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] The token cache is being invalidate because project 3bbaa3e01f4d4076940d93f230f20be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:16.663209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.664488 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.669841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1190/2348] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:16 2022] DELETE /identity/v3/projects/3bbaa3e01f4d4076940d93f230f20be0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:16.670760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:16.673101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:16.695400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19bacb-f996-4fce-8c9d-daebb3c9e7bd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:16.734731 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:16.787275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:16.788343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:16.789335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:16.790209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] PATH_INFO: `/v3/users/21e48cdffebf4ed483a100bacbb5183a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:16.791524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e48cdffebf4ed483a100bacbb5183a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:16.794490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:16.873064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e48cdffebf4ed483a100bacbb5183a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.887665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e48cdffebf4ed483a100bacbb5183a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.888378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e48cdffebf4ed483a100bacbb5183a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.900911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e48cdffebf4ed483a100bacbb5183a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.901849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e48cdffebf4ed483a100bacbb5183a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:16.918781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1159/2349] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:16 2022] DELETE /identity/v3/users/21e48cdffebf4ed483a100bacbb5183a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:17.328299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:17.334998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:17.401349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ecc56-7b6b-4319-85ee-6a19def2997d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:17.545330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:17.545330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:17.545330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:17.545330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] PATH_INFO: `/v3/projects/337ee655466c4fc8a31acd7ec63f58ea` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:17.546192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337ee655466c4fc8a31acd7ec63f58ea)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:17.546192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:17.610591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337ee655466c4fc8a31acd7ec63f58ea', 'request_id': 'req-d70564dc-cdb9-4e25-aaf3-409aef20fae3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:17.620135 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337ee655466c4fc8a31acd7ec63f58ea', 'request_id': 'req-d70564dc-cdb9-4e25-aaf3-409aef20fae3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:17.634027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337ee655466c4fc8a31acd7ec63f58ea', 'request_id': 'req-d70564dc-cdb9-4e25-aaf3-409aef20fae3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:17.652926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] The token cache is being invalidate because project 337ee655466c4fc8a31acd7ec63f58ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:17.653574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:17.654637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d70564dc-cdb9-4e25-aaf3-409aef20fae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:17.656343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1191/2350] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:17 2022] DELETE /identity/v3/projects/337ee655466c4fc8a31acd7ec63f58ea => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:18.583748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:18.589155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:18.621071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c1793-b47e-423d-a38e-c540c5046d1c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:18.740094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:18.740792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:18.741106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:18.741381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] PATH_INFO: `/v3/users/da8a593d5e854501a8f56969d1a7b2cd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:18.751406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8a593d5e854501a8f56969d1a7b2cd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:18.751406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:18.816475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8a593d5e854501a8f56969d1a7b2cd'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:18.818880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:18.874303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8a593d5e854501a8f56969d1a7b2cd'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:18.875197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8a593d5e854501a8f56969d1a7b2cd'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:18.910856 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8a593d5e854501a8f56969d1a7b2cd'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:18.912656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8a593d5e854501a8f56969d1a7b2cd'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:18.934248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1160/2351] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:18 2022] DELETE /identity/v3/users/da8a593d5e854501a8f56969d1a7b2cd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:18.938855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b14a-94b6-421c-9744-5d2a61284296 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:18.939409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b14a-94b6-421c-9744-5d2a61284296 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:18.939409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3b14a-94b6-421c-9744-5d2a61284296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:18.977351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-adc3b14a-94b6-421c-9744-5d2a61284296 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:18.978864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-adc3b14a-94b6-421c-9744-5d2a61284296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:19.052274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:19.108257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1192/2352] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:19.118131 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:19.119590 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:19.213462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e00ae-8f54-437a-818e-24089881f253 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:19.218008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e73b9-0089-4b44-ac45-2d6ba7de5f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:19.218595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e73b9-0089-4b44-ac45-2d6ba7de5f5d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:19.218885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e73b9-0089-4b44-ac45-2d6ba7de5f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:19.219163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e73b9-0089-4b44-ac45-2d6ba7de5f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:19.230805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e73b9-0089-4b44-ac45-2d6ba7de5f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:19.232660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e73b9-0089-4b44-ac45-2d6ba7de5f5d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:19.259485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1161/2353] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:19.745822 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3b14a-94b6-421c-9744-5d2a61284296 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:19.747705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-adc3b14a-94b6-421c-9744-5d2a61284296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:19.771360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3b14a-94b6-421c-9744-5d2a61284296 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:19.781639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:19.782989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:19.783382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:19.783768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] PATH_INFO: `/v3/projects/ebce5b6adca340a0a37d2917c450db36` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:19.785179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebce5b6adca340a0a37d2917c450db36)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:19.787991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:19.860467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebce5b6adca340a0a37d2917c450db36', 'request_id': 'req-84db0c78-b54e-4170-86e6-a1eb49c2c356'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:19.868157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebce5b6adca340a0a37d2917c450db36', 'request_id': 'req-84db0c78-b54e-4170-86e6-a1eb49c2c356'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:19.875211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebce5b6adca340a0a37d2917c450db36', 'request_id': 'req-84db0c78-b54e-4170-86e6-a1eb49c2c356'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:19.894248 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] The token cache is being invalidate because project ebce5b6adca340a0a37d2917c450db36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:19.894826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:19.895670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-84db0c78-b54e-4170-86e6-a1eb49c2c356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:19.898487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1193/2354] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:19 2022] DELETE /identity/v3/projects/ebce5b6adca340a0a37d2917c450db36 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:19.903111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e218e2-8feb-49b2-ae7d-f22bb9f0302d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:19.903656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e218e2-8feb-49b2-ae7d-f22bb9f0302d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:19.903656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e218e2-8feb-49b2-ae7d-f22bb9f0302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:19.931469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-89e218e2-8feb-49b2-ae7d-f22bb9f0302d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:19.933172 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-89e218e2-8feb-49b2-ae7d-f22bb9f0302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:20.021263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1162/2355] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:20.029121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630513e8-fae7-4012-8a61-d0b29d53ec27 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.030154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630513e8-fae7-4012-8a61-d0b29d53ec27 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.030538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630513e8-fae7-4012-8a61-d0b29d53ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.063007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-630513e8-fae7-4012-8a61-d0b29d53ec27 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:20.064603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-630513e8-fae7-4012-8a61-d0b29d53ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:20.077424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1194/2356] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:20.079430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e218e2-8feb-49b2-ae7d-f22bb9f0302d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:20.091175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e218e2-8feb-49b2-ae7d-f22bb9f0302d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:20.098322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:20.099268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.099724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.100098 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.100928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:01:20.101970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:20.103736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:20.124102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1163/2357] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:01:20.126277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630513e8-fae7-4012-8a61-d0b29d53ec27 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:20.139542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630513e8-fae7-4012-8a61-d0b29d53ec27 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:20.145897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707a2d-4e6d-48b9-a2d0-63daf28ee7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:20.146641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707a2d-4e6d-48b9-a2d0-63daf28ee7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.147026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707a2d-4e6d-48b9-a2d0-63daf28ee7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.147814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707a2d-4e6d-48b9-a2d0-63daf28ee7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.149185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b707a2d-4e6d-48b9-a2d0-63daf28ee7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:20.151770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b707a2d-4e6d-48b9-a2d0-63daf28ee7e3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:20.195364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1195/2358] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:01:20 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:20.196928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:20.208377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343e7c3-2018-4670-8755-861e5e3d4e50 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:20.280709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:20.309802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b9ed3-ad86-4c13-8f1f-c38c546610a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:20.310639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b9ed3-ad86-4c13-8f1f-c38c546610a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.311068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b9ed3-ad86-4c13-8f1f-c38c546610a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.311501 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b9ed3-ad86-4c13-8f1f-c38c546610a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.317085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b9ed3-ad86-4c13-8f1f-c38c546610a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:20.319931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b9ed3-ad86-4c13-8f1f-c38c546610a3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:20.358557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1164/2359] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:01:20 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:20.359842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707a2d-4e6d-48b9-a2d0-63daf28ee7e3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:20.373774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707a2d-4e6d-48b9-a2d0-63daf28ee7e3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:20.379830 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54bd96-1cd5-455b-9a58-c09f19647687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:20.380582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54bd96-1cd5-455b-9a58-c09f19647687 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.380963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54bd96-1cd5-455b-9a58-c09f19647687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.381373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54bd96-1cd5-455b-9a58-c09f19647687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.382126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54bd96-1cd5-455b-9a58-c09f19647687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:20.383877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54bd96-1cd5-455b-9a58-c09f19647687 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:20.407658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1196/2360] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:01:20.407894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b9ed3-ad86-4c13-8f1f-c38c546610a3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:20.422313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b9ed3-ad86-4c13-8f1f-c38c546610a3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:20.435672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c6479-2b41-43f7-af8f-c5e04d11cd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:20.436301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c6479-2b41-43f7-af8f-c5e04d11cd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.436586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c6479-2b41-43f7-af8f-c5e04d11cd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.436861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c6479-2b41-43f7-af8f-c5e04d11cd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.439413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c6479-2b41-43f7-af8f-c5e04d11cd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:20.440942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c6479-2b41-43f7-af8f-c5e04d11cd65 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:20.474624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1165/2361] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:01:20.475937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54bd96-1cd5-455b-9a58-c09f19647687 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:20.486988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54bd96-1cd5-455b-9a58-c09f19647687 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:20.495790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:20.496474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.496756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.497067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] PATH_INFO: `/v3/projects/897365ac5a174c34b939103e84afe363/users/b88989c8c53c49afa4e53c72bdcfec80/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.514923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897365ac5a174c34b939103e84afe363, user_id=b88989c8c53c49afa4e53c72bdcfec80, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:20.518758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:20.536834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1197/2362] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:01:20 2022] PUT /identity/v3/projects/897365ac5a174c34b939103e84afe363/users/b88989c8c53c49afa4e53c72bdcfec80/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:20.545026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a2c4-6113-45c6-ae54-80be3f1e93dc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.545359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a2c4-6113-45c6-ae54-80be3f1e93dc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.545589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a2c4-6113-45c6-ae54-80be3f1e93dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.582027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-01b1a2c4-6113-45c6-ae54-80be3f1e93dc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:20.583263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-01b1a2c4-6113-45c6-ae54-80be3f1e93dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:20.707122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1166/2363] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:20.714019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:20.715997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:20.793994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd62e8-fac5-4086-934e-de9877bdffd6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:20.798219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17225b85-90e1-482d-81c1-dfc9a7edff6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:20.798981 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17225b85-90e1-482d-81c1-dfc9a7edff6a service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.799388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17225b85-90e1-482d-81c1-dfc9a7edff6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.799863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17225b85-90e1-482d-81c1-dfc9a7edff6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.811111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17225b85-90e1-482d-81c1-dfc9a7edff6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:20.812546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17225b85-90e1-482d-81c1-dfc9a7edff6a service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:20.818905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:20.837588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed099b-100c-4a86-8673-8303f24dab86 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:20.838468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed099b-100c-4a86-8673-8303f24dab86 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:20.839104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1198/2364] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:20.844242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed099b-100c-4a86-8673-8303f24dab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:20.950163 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-61ed099b-100c-4a86-8673-8303f24dab86 None None] MFA Rules not processed for user `912b5f1275fb43dfb1c0a9c47ecb3fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:20.952749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61ed099b-100c-4a86-8673-8303f24dab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:21.028406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1167/2365] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:22.252075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0032cc-d318-4d20-b633-4062818972f3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:22.252511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0032cc-d318-4d20-b633-4062818972f3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:22.252615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0032cc-d318-4d20-b633-4062818972f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:22.327420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5f0032cc-d318-4d20-b633-4062818972f3 None None] MFA Rules not processed for user `b88989c8c53c49afa4e53c72bdcfec80`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:22.332455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5f0032cc-d318-4d20-b633-4062818972f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:22.462958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1199/2366] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:22.482173 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed099b-100c-4a86-8673-8303f24dab86 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:22.483867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61ed099b-100c-4a86-8673-8303f24dab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:22.644359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed099b-100c-4a86-8673-8303f24dab86 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:22.648707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9478edb-038f-4ef6-9660-772a6a21d00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:22.649618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478edb-038f-4ef6-9660-772a6a21d00a service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:22.650109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478edb-038f-4ef6-9660-772a6a21d00a service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:22.650610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478edb-038f-4ef6-9660-772a6a21d00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:22.675302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9478edb-038f-4ef6-9660-772a6a21d00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:22.679362 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9478edb-038f-4ef6-9660-772a6a21d00a service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:22.703287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1168/2367] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:23.395151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0032cc-d318-4d20-b633-4062818972f3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:23.396655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5f0032cc-d318-4d20-b633-4062818972f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:23.423799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0032cc-d318-4d20-b633-4062818972f3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:23.430497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:23.431249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:23.431628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:23.431963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] PATH_INFO: `/v3/users/454cba938ec84f1b924a766ff2a82b52` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:23.433293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454cba938ec84f1b924a766ff2a82b52)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:23.435367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:23.506920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454cba938ec84f1b924a766ff2a82b52'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:23.541453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454cba938ec84f1b924a766ff2a82b52'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:23.542433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454cba938ec84f1b924a766ff2a82b52'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:23.582255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454cba938ec84f1b924a766ff2a82b52'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:23.582978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454cba938ec84f1b924a766ff2a82b52'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:23.598991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1200/2368] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:01:23 2022] DELETE /identity/v3/users/454cba938ec84f1b924a766ff2a82b52 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:23.604466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a6d31-2348-457f-8e91-181ce43e0ef9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:23.604996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a6d31-2348-457f-8e91-181ce43e0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:23.605084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a6d31-2348-457f-8e91-181ce43e0ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:23.628702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-160a6d31-2348-457f-8e91-181ce43e0ef9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:23.630108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-160a6d31-2348-457f-8e91-181ce43e0ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:23.645438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:23.720439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1169/2369] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:23.737134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:23.739057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:23.860142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d08d8-063c-48d9-9b35-a179348f4b60 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:23.870015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:23.871034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:23.871320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:23.871593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:23.894561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:23.895986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:23.913040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1201/2370] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:24.292126 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04527f0-2e04-40fa-9bba-b5493530fd60 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.292417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04527f0-2e04-40fa-9bba-b5493530fd60 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.292695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04527f0-2e04-40fa-9bba-b5493530fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.322828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e04527f0-2e04-40fa-9bba-b5493530fd60 None None] MFA Rules not processed for user `b88989c8c53c49afa4e53c72bdcfec80`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:24.324435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e04527f0-2e04-40fa-9bba-b5493530fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:24.356647 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:24.358807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:24.371639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:24.375666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32857-abf8-42d1-84ca-5b0adaedc21e service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:24.392094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:24.392732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.393076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.393299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] PATH_INFO: `/v3/projects/552c7ecb06df4caf869d2c01f331b0b1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.394519 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552c7ecb06df4caf869d2c01f331b0b1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:24.396392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:24.411532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1170/2371] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:24.493871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552c7ecb06df4caf869d2c01f331b0b1', 'request_id': 'req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:24.500081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552c7ecb06df4caf869d2c01f331b0b1', 'request_id': 'req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:24.500636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344eb4e-4f71-4043-9fa5-c02ad3f4033a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.500929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344eb4e-4f71-4043-9fa5-c02ad3f4033a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.501281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344eb4e-4f71-4043-9fa5-c02ad3f4033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.507107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552c7ecb06df4caf869d2c01f331b0b1', 'request_id': 'req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:24.520868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8344eb4e-4f71-4043-9fa5-c02ad3f4033a None None] MFA Rules not processed for user `f61f3182cb9d48d0ba6f417e2afb0809`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:24.522122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8344eb4e-4f71-4043-9fa5-c02ad3f4033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:24.525906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] The token cache is being invalidate because project 552c7ecb06df4caf869d2c01f331b0b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:01:24.526291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:24.526985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7abc438a-c161-4c4c-af73-62aa5e2f2bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:01:24.532506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1202/2372] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:01:24 2022] DELETE /identity/v3/projects/552c7ecb06df4caf869d2c01f331b0b1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:01:24.535736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202cd66-7486-445c-a175-87639add7e28 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.535736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202cd66-7486-445c-a175-87639add7e28 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.535953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202cd66-7486-445c-a175-87639add7e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.563674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2202cd66-7486-445c-a175-87639add7e28 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:24.565064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2202cd66-7486-445c-a175-87639add7e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:24.588852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1171/2373] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:01:24.634241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1203/2374] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:24.642958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221dfa-82ba-40eb-96cf-082a5aadf8c0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.643406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221dfa-82ba-40eb-96cf-082a5aadf8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.643513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221dfa-82ba-40eb-96cf-082a5aadf8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.668503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-df221dfa-82ba-40eb-96cf-082a5aadf8c0 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:24.669913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-df221dfa-82ba-40eb-96cf-082a5aadf8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:24.679152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1172/2375] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:24.683237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202cd66-7486-445c-a175-87639add7e28 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:24.693480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202cd66-7486-445c-a175-87639add7e28 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:24.698413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:24.699027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.699306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.699579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.700232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:01:24.700539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:24.702289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:24.718772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1204/2376] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:01:24.723026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221dfa-82ba-40eb-96cf-082a5aadf8c0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:24.739179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221dfa-82ba-40eb-96cf-082a5aadf8c0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:24.746044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524094d9-a332-413a-aa42-1f5422c1cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:24.747185 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524094d9-a332-413a-aa42-1f5422c1cf60 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.748492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524094d9-a332-413a-aa42-1f5422c1cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.748965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524094d9-a332-413a-aa42-1f5422c1cf60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.750028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524094d9-a332-413a-aa42-1f5422c1cf60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:24.752695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524094d9-a332-413a-aa42-1f5422c1cf60 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:24.789723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1173/2377] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:01:24 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:01:24.793800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:24.807734 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c906-fa26-4554-85d6-15bd9df2616a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:24.903335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951813c-9814-4088-8482-9349be223e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:24.904504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951813c-9814-4088-8482-9349be223e7f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.904816 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951813c-9814-4088-8482-9349be223e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.905422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951813c-9814-4088-8482-9349be223e7f admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.906186 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951813c-9814-4088-8482-9349be223e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:24.908175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951813c-9814-4088-8482-9349be223e7f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:24.944287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1205/2378] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:01:24 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:01:24.945629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524094d9-a332-413a-aa42-1f5422c1cf60 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:24.960787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524094d9-a332-413a-aa42-1f5422c1cf60 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:24.970238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a010b66-7215-46fd-96c5-9089485d5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:24.971228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a010b66-7215-46fd-96c5-9089485d5057 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:24.971669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a010b66-7215-46fd-96c5-9089485d5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:24.972102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a010b66-7215-46fd-96c5-9089485d5057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:24.973270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a010b66-7215-46fd-96c5-9089485d5057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:24.975085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a010b66-7215-46fd-96c5-9089485d5057 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:24.988921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1174/2379] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:01:24.993113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951813c-9814-4088-8482-9349be223e7f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:25.000411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:25.004840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951813c-9814-4088-8482-9349be223e7f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:25.015612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70e58e-f861-4332-ac4d-34073546c161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:25.016831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70e58e-f861-4332-ac4d-34073546c161 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:25.017593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70e58e-f861-4332-ac4d-34073546c161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:25.017867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70e58e-f861-4332-ac4d-34073546c161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:25.018687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70e58e-f861-4332-ac4d-34073546c161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:25.020326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70e58e-f861-4332-ac4d-34073546c161 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:25.035887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1206/2380] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:01:25.037087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a010b66-7215-46fd-96c5-9089485d5057 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:25.050251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a010b66-7215-46fd-96c5-9089485d5057 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:25.057508 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:25.058198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:25.058486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:25.058765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] PATH_INFO: `/v3/projects/c04f89e2ce074f7d9bbd273417d7ff5e/users/5aea3a2d00174bd5b256103a56214359/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:25.076387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04f89e2ce074f7d9bbd273417d7ff5e, user_id=5aea3a2d00174bd5b256103a56214359, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:25.079128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:25.096668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1175/2381] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:01:25 2022] PUT /identity/v3/projects/c04f89e2ce074f7d9bbd273417d7ff5e/users/5aea3a2d00174bd5b256103a56214359/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:01:25.107113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce770d05-54b5-4c49-8def-2c1805737a8d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:25.107442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce770d05-54b5-4c49-8def-2c1805737a8d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:25.107679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce770d05-54b5-4c49-8def-2c1805737a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:25.140671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ce770d05-54b5-4c49-8def-2c1805737a8d None None] MFA Rules not processed for user `5aea3a2d00174bd5b256103a56214359`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:25.143253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ce770d05-54b5-4c49-8def-2c1805737a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:25.231902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1207/2382] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:25.243097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:25.245570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:25.253593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:25.330255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d1a1-27ee-4ebc-9503-e5328825e0a7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:25.338001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc1c05-34da-45ce-9b78-a5642cd34da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:25.338629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1c05-34da-45ce-9b78-a5642cd34da6 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:25.339050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1c05-34da-45ce-9b78-a5642cd34da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:25.339331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc1c05-34da-45ce-9b78-a5642cd34da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:25.349687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc1c05-34da-45ce-9b78-a5642cd34da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:25.351274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc1c05-34da-45ce-9b78-a5642cd34da6 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:25.365655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1176/2383] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:01:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:01:26.930210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af53c-23c8-44a5-a3b3-4b9b03a35635 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:26.930651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af53c-23c8-44a5-a3b3-4b9b03a35635 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:26.930881 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7af53c-23c8-44a5-a3b3-4b9b03a35635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:26.954006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ec7af53c-23c8-44a5-a3b3-4b9b03a35635 None None] MFA Rules not processed for user `5aea3a2d00174bd5b256103a56214359`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:26.955385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ec7af53c-23c8-44a5-a3b3-4b9b03a35635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:26.969010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1208/2384] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:28.511219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39650ee-053e-478b-a02e-a6093bd98ea8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:28.512035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39650ee-053e-478b-a02e-a6093bd98ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:28.512318 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39650ee-053e-478b-a02e-a6093bd98ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:28.533208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b39650ee-053e-478b-a02e-a6093bd98ea8 None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:28.534544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b39650ee-053e-478b-a02e-a6093bd98ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:28.603295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1177/2385] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:01:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:01:28.618863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af53c-23c8-44a5-a3b3-4b9b03a35635 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:01:28.620443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ec7af53c-23c8-44a5-a3b3-4b9b03a35635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:28.701326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7af53c-23c8-44a5-a3b3-4b9b03a35635 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:01:28.703504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:01:28.704209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:28.704568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:28.704922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:28.714342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:01:28.715958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:01:28.725090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1209/2386] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:01:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:01:38.596354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=49 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:38.721909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=70 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:01:54.388387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b43d-1217-40af-ba10-e00490331317 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:01:54.388998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b43d-1217-40af-ba10-e00490331317 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:01:54.389111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b43d-1217-40af-ba10-e00490331317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:01:54.409836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a782b43d-1217-40af-ba10-e00490331317 None None] MFA Rules not processed for user `8fdf7fcf986c43b895e4c76c4dd2adff`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:01:54.411043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a782b43d-1217-40af-ba10-e00490331317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:01:54.466868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1178/2387] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:04.459496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=25 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:05.800687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:05.802892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:05.894946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d21f-69f4-4cd7-b99c-054b584c2cf1 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:05.899225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:05.899846 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:05.911450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:05.911749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:05.914103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:05.994827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:05.996290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:06.007200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1210/2388] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:09.034319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229db5e-c3a6-4d2c-804b-05040def5d6d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:09.035133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229db5e-c3a6-4d2c-804b-05040def5d6d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:09.035348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229db5e-c3a6-4d2c-804b-05040def5d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:09.060071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f229db5e-c3a6-4d2c-804b-05040def5d6d None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:09.061897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f229db5e-c3a6-4d2c-804b-05040def5d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:09.079815 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1179/2389] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:09.107530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:09.122495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7059b-8d8a-4f0c-833c-a2d9d908243f service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:09.127814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8dc4a-5b8e-48ec-a4b0-9c84344fb857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:09.128504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8dc4a-5b8e-48ec-a4b0-9c84344fb857 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:09.128849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8dc4a-5b8e-48ec-a4b0-9c84344fb857 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:09.129345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8dc4a-5b8e-48ec-a4b0-9c84344fb857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:09.139219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8dc4a-5b8e-48ec-a4b0-9c84344fb857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:09.140946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8dc4a-5b8e-48ec-a4b0-9c84344fb857 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:09.150007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1211/2390] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:02:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:02:09.756422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61186113-76e9-40fe-8e24-ec1103f71fee None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:09.756710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61186113-76e9-40fe-8e24-ec1103f71fee None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:09.757012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61186113-76e9-40fe-8e24-ec1103f71fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:09.780033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-61186113-76e9-40fe-8e24-ec1103f71fee None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:09.781424 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-61186113-76e9-40fe-8e24-ec1103f71fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:09.789976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1180/2391] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 10 12:02:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:09.805873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8dc4a-5b8e-48ec-a4b0-9c84344fb857 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:09.818305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8dc4a-5b8e-48ec-a4b0-9c84344fb857 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:09.829866 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe293c5e-0d1a-4362-9a6d-f9b1d0322555 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:09.831067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe293c5e-0d1a-4362-9a6d-f9b1d0322555 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:09.831531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe293c5e-0d1a-4362-9a6d-f9b1d0322555 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:09.831976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe293c5e-0d1a-4362-9a6d-f9b1d0322555 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:09.841913 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe293c5e-0d1a-4362-9a6d-f9b1d0322555 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:09.843494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe293c5e-0d1a-4362-9a6d-f9b1d0322555 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:09.851975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1212/2392] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:02:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:02:10.146739 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fa58c-c06a-4d9b-8a99-eed3ee4ba51a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:10.147848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fa58c-c06a-4d9b-8a99-eed3ee4ba51a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:10.148278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fa58c-c06a-4d9b-8a99-eed3ee4ba51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:10.176602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f53fa58c-c06a-4d9b-8a99-eed3ee4ba51a None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:10.182642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f53fa58c-c06a-4d9b-8a99-eed3ee4ba51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:10.196001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1181/2393] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:10.216997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe293c5e-0d1a-4362-9a6d-f9b1d0322555 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:10.231943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe293c5e-0d1a-4362-9a6d-f9b1d0322555 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:10.250603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81eb42-a145-45d9-a22c-c69482bb0e58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:10.251848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81eb42-a145-45d9-a22c-c69482bb0e58 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:10.252338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81eb42-a145-45d9-a22c-c69482bb0e58 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:10.253000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81eb42-a145-45d9-a22c-c69482bb0e58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:10.266318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81eb42-a145-45d9-a22c-c69482bb0e58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:10.269284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81eb42-a145-45d9-a22c-c69482bb0e58 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:10.282257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1213/2394] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:02:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:02:10.666053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509c13-2c7d-4086-95fc-2fc7e40a403f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:10.666326 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509c13-2c7d-4086-95fc-2fc7e40a403f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:10.666768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc509c13-2c7d-4086-95fc-2fc7e40a403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:10.688222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cc509c13-2c7d-4086-95fc-2fc7e40a403f None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:10.690621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cc509c13-2c7d-4086-95fc-2fc7e40a403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:10.702979 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1182/2395] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 10 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:10.715856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81eb42-a145-45d9-a22c-c69482bb0e58 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:10.726896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81eb42-a145-45d9-a22c-c69482bb0e58 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:10.737681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b7088-80e6-4f16-ab4a-d5bd383f1607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:10.738366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7088-80e6-4f16-ab4a-d5bd383f1607 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:10.738773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7088-80e6-4f16-ab4a-d5bd383f1607 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:10.739024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7088-80e6-4f16-ab4a-d5bd383f1607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:10.771728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b7088-80e6-4f16-ab4a-d5bd383f1607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:10.773977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b7088-80e6-4f16-ab4a-d5bd383f1607 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:10.786288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1214/2396] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:02:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:02:12.972006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc509c13-2c7d-4086-95fc-2fc7e40a403f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:13.035839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc509c13-2c7d-4086-95fc-2fc7e40a403f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:13.040405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:13.041067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.041353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.041629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] PATH_INFO: `/v3/users/5aea3a2d00174bd5b256103a56214359` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.042806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aea3a2d00174bd5b256103a56214359)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:13.045051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:13.101801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aea3a2d00174bd5b256103a56214359'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.113719 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aea3a2d00174bd5b256103a56214359'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.114408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aea3a2d00174bd5b256103a56214359'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.122024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aea3a2d00174bd5b256103a56214359'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.122704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aea3a2d00174bd5b256103a56214359'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.134968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1183/2397] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:02:12 2022] DELETE /identity/v3/users/5aea3a2d00174bd5b256103a56214359 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:02:13.140083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b1d5-80fa-4b08-8807-c6a085417138 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.140796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b1d5-80fa-4b08-8807-c6a085417138 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.140796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b1d5-80fa-4b08-8807-c6a085417138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.161110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2478b1d5-80fa-4b08-8807-c6a085417138 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:13.162307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2478b1d5-80fa-4b08-8807-c6a085417138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:13.218688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:13.228313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1215/2398] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:13.237991 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:13.239492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:13.310645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58128a6-df28-4028-978a-f225291706ac admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:13.314384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b209f-f772-49b9-a8b5-23e6f9da9855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:13.315000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b209f-f772-49b9-a8b5-23e6f9da9855 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.315280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b209f-f772-49b9-a8b5-23e6f9da9855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.315552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b209f-f772-49b9-a8b5-23e6f9da9855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.323689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:13.326165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b209f-f772-49b9-a8b5-23e6f9da9855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:13.328044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b209f-f772-49b9-a8b5-23e6f9da9855 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:13.339239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1184/2399] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:13.521017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b1d5-80fa-4b08-8807-c6a085417138 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:13.522465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2478b1d5-80fa-4b08-8807-c6a085417138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:13.539419 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b1d5-80fa-4b08-8807-c6a085417138 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:13.547798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:13.548764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.549228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.549339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] PATH_INFO: `/v3/projects/c04f89e2ce074f7d9bbd273417d7ff5e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.550626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04f89e2ce074f7d9bbd273417d7ff5e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:13.552462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:13.598015 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04f89e2ce074f7d9bbd273417d7ff5e', 'request_id': 'req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.603567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04f89e2ce074f7d9bbd273417d7ff5e', 'request_id': 'req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.610373 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04f89e2ce074f7d9bbd273417d7ff5e', 'request_id': 'req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.622873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] The token cache is being invalidate because project c04f89e2ce074f7d9bbd273417d7ff5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:02:13.623169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.623787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e3fd8cfe-7db8-4a8e-b545-ee04752b0f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:02:13.625277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1216/2400] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:02:13 2022] DELETE /identity/v3/projects/c04f89e2ce074f7d9bbd273417d7ff5e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:02:13.630486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572ae4-6e76-430f-bf70-04a13c1d194b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.630808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572ae4-6e76-430f-bf70-04a13c1d194b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.631084 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572ae4-6e76-430f-bf70-04a13c1d194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.652119 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2b572ae4-6e76-430f-bf70-04a13c1d194b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:13.653901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2b572ae4-6e76-430f-bf70-04a13c1d194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:13.715316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1185/2401] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:13.723764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836453b-fa3f-4772-bd1a-266d43615a0b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.724052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836453b-fa3f-4772-bd1a-266d43615a0b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.724329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836453b-fa3f-4772-bd1a-266d43615a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.744658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f836453b-fa3f-4772-bd1a-266d43615a0b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:13.745896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f836453b-fa3f-4772-bd1a-266d43615a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:13.754463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1217/2402] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:02:13.758795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572ae4-6e76-430f-bf70-04a13c1d194b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:13.769332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572ae4-6e76-430f-bf70-04a13c1d194b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:13.773962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:13.774563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.774845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.775117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.775763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:02:13.776065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:13.777692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:13.790023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1186/2403] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:02:13.794356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836453b-fa3f-4772-bd1a-266d43615a0b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:13.804064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836453b-fa3f-4772-bd1a-266d43615a0b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:13.813546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2881f-94d6-492e-a531-8925e9b43273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:13.813546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2881f-94d6-492e-a531-8925e9b43273 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.813546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2881f-94d6-492e-a531-8925e9b43273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.813546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2881f-94d6-492e-a531-8925e9b43273 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.814011 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2881f-94d6-492e-a531-8925e9b43273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:13.814011 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2881f-94d6-492e-a531-8925e9b43273 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:13.843727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1218/2404] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:02:13 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:02:13.847807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:13.857892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4086-7138-4c63-ba05-c8fd18348a44 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:13.916381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b5e1-5c06-4714-a514-7aea15364669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:13.917037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b5e1-5c06-4714-a514-7aea15364669 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.917329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b5e1-5c06-4714-a514-7aea15364669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.917602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b5e1-5c06-4714-a514-7aea15364669 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.918241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b5e1-5c06-4714-a514-7aea15364669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:13.920142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b5e1-5c06-4714-a514-7aea15364669 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:13.941068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1187/2405] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:02:13 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:02:13.945222 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2881f-94d6-492e-a531-8925e9b43273 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:13.957012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2881f-94d6-492e-a531-8925e9b43273 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:13.961788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bdb07-b0e3-46ae-9543-0a39b6a7f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:13.962486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bdb07-b0e3-46ae-9543-0a39b6a7f86a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.962904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bdb07-b0e3-46ae-9543-0a39b6a7f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.963235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bdb07-b0e3-46ae-9543-0a39b6a7f86a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.963952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bdb07-b0e3-46ae-9543-0a39b6a7f86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:13.966343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bdb07-b0e3-46ae-9543-0a39b6a7f86a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:13.976291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1219/2406] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:02:13.980214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b5e1-5c06-4714-a514-7aea15364669 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:13.990094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b5e1-5c06-4714-a514-7aea15364669 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:13.994679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ebd61-8d3e-481b-b654-fc9dff6d6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:13.995262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebd61-8d3e-481b-b654-fc9dff6d6728 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:13.995542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebd61-8d3e-481b-b654-fc9dff6d6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:13.995819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebd61-8d3e-481b-b654-fc9dff6d6728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:13.996449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ebd61-8d3e-481b-b654-fc9dff6d6728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:13.998046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ebd61-8d3e-481b-b654-fc9dff6d6728 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:14.007595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1188/2407] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:02:14.011476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bdb07-b0e3-46ae-9543-0a39b6a7f86a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:14.021657 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bdb07-b0e3-46ae-9543-0a39b6a7f86a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:14.026174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:14.026803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:14.027083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:14.027356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] PATH_INFO: `/v3/projects/8e205554b118462698819aaa02d172d9/users/899c4dc4a6264142bcc22acbbe9b12d9/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:14.042129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e205554b118462698819aaa02d172d9, user_id=899c4dc4a6264142bcc22acbbe9b12d9, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:14.044819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:14.057887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1220/2408] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:02:14 2022] PUT /identity/v3/projects/8e205554b118462698819aaa02d172d9/users/899c4dc4a6264142bcc22acbbe9b12d9/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:02:14.062763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa254-c046-46c7-abe0-f5a24c431432 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:14.063050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa254-c046-46c7-abe0-f5a24c431432 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:14.063319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa254-c046-46c7-abe0-f5a24c431432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:14.083200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-13afa254-c046-46c7-abe0-f5a24c431432 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:14.084382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-13afa254-c046-46c7-abe0-f5a24c431432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:14.141517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1189/2409] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:02:14.151356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:14.153210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:14.210738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efde8bf-11b9-4244-b6b5-f12debc21037 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:14.214534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cf918-6de3-440f-8fd9-3aafc5889e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:14.215146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf918-6de3-440f-8fd9-3aafc5889e0d service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:14.215427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf918-6de3-440f-8fd9-3aafc5889e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:14.215730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cf918-6de3-440f-8fd9-3aafc5889e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:14.225342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cf918-6de3-440f-8fd9-3aafc5889e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:14.226761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cf918-6de3-440f-8fd9-3aafc5889e0d service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:14.236392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1221/2410] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:19.625678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6ca0-933e-455d-9f14-3a132f653bc8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:19.626254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6ca0-933e-455d-9f14-3a132f653bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:19.626254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6ca0-933e-455d-9f14-3a132f653bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:19.633506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:19.661106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fffc6ca0-933e-455d-9f14-3a132f653bc8 None None] MFA Rules not processed for user `899c4dc4a6264142bcc22acbbe9b12d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:19.662639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fffc6ca0-933e-455d-9f14-3a132f653bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:19.733403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1190/2411] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:02:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:19.737966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cf918-6de3-440f-8fd9-3aafc5889e0d service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:19.749109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cf918-6de3-440f-8fd9-3aafc5889e0d service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:19.753680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740383c-580a-4ddd-91f0-3933088ad5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:19.754273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740383c-580a-4ddd-91f0-3933088ad5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:19.754553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740383c-580a-4ddd-91f0-3933088ad5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:19.754828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740383c-580a-4ddd-91f0-3933088ad5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:19.755675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740383c-580a-4ddd-91f0-3933088ad5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:19.757737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740383c-580a-4ddd-91f0-3933088ad5bb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:19.780012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:19.792315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1222/2412] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:02:19 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:02:19.793300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc6ca0-933e-455d-9f14-3a132f653bc8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:19.804956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc6ca0-933e-455d-9f14-3a132f653bc8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:19.862527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896e8d-1e34-47a1-86e5-64af081a5e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:19.862527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896e8d-1e34-47a1-86e5-64af081a5e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:19.862917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896e8d-1e34-47a1-86e5-64af081a5e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:19.863192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25896e8d-1e34-47a1-86e5-64af081a5e3a admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:19.863831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25896e8d-1e34-47a1-86e5-64af081a5e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:19.865759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25896e8d-1e34-47a1-86e5-64af081a5e3a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:19.887246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1191/2413] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:02:19 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:02:19.891355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740383c-580a-4ddd-91f0-3933088ad5bb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:19.902096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740383c-580a-4ddd-91f0-3933088ad5bb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:19.909642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd93e-a869-42a4-a032-378942253854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:19.910262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd93e-a869-42a4-a032-378942253854 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:19.910548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd93e-a869-42a4-a032-378942253854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:19.910826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd93e-a869-42a4-a032-378942253854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:19.911470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd93e-a869-42a4-a032-378942253854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:19.913093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd93e-a869-42a4-a032-378942253854 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:19.924496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1223/2414] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:02:19.928674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896e8d-1e34-47a1-86e5-64af081a5e3a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:19.939872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25896e8d-1e34-47a1-86e5-64af081a5e3a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:19.944703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f01a-69c0-4c69-a0da-2d6c1c4bb616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:19.945393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f01a-69c0-4c69-a0da-2d6c1c4bb616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:19.945733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f01a-69c0-4c69-a0da-2d6c1c4bb616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:19.945948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5f01a-69c0-4c69-a0da-2d6c1c4bb616 admin admin] PATH_INFO: `/v3/projects/188280fb01044e2faa134c974bb8b1d5/users/391457eb45a646678d4ef035603fb00d/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:19.961382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5f01a-69c0-4c69-a0da-2d6c1c4bb616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188280fb01044e2faa134c974bb8b1d5, user_id=391457eb45a646678d4ef035603fb00d, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:19.965918 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5f01a-69c0-4c69-a0da-2d6c1c4bb616 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:19.989747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1192/2415] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:02:19 2022] PUT /identity/v3/projects/188280fb01044e2faa134c974bb8b1d5/users/391457eb45a646678d4ef035603fb00d/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:02:19.991032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd93e-a869-42a4-a032-378942253854 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:20.002204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd93e-a869-42a4-a032-378942253854 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:20.062209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5580f5-1daf-4d32-a5d3-441d788ac72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:20.062826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5580f5-1daf-4d32-a5d3-441d788ac72b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:20.063106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5580f5-1daf-4d32-a5d3-441d788ac72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:20.063481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5580f5-1daf-4d32-a5d3-441d788ac72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:20.064117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5580f5-1daf-4d32-a5d3-441d788ac72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:20.065976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5580f5-1daf-4d32-a5d3-441d788ac72b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:20.076038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1224/2416] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:02:20.081164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f01a-69c0-4c69-a0da-2d6c1c4bb616 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:20.091645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5f01a-69c0-4c69-a0da-2d6c1c4bb616 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:20.096653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:20.097463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:20.097819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:20.098162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] PATH_INFO: `/v3/projects/188280fb01044e2faa134c974bb8b1d5/users/391457eb45a646678d4ef035603fb00d/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:20.100197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188280fb01044e2faa134c974bb8b1d5, user_id=391457eb45a646678d4ef035603fb00d, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:20.102974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:20.115507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1193/2417] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:02:20 2022] PUT /identity/v3/projects/188280fb01044e2faa134c974bb8b1d5/users/391457eb45a646678d4ef035603fb00d/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:02:20.546471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781488-7a99-4ccc-9f1c-c27d9deeccb3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:20.546847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781488-7a99-4ccc-9f1c-c27d9deeccb3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:20.547036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781488-7a99-4ccc-9f1c-c27d9deeccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:20.569279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a3781488-7a99-4ccc-9f1c-c27d9deeccb3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:20.570687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a3781488-7a99-4ccc-9f1c-c27d9deeccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:20.659473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1225/2418] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:20.684201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:20.686340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:20.767930 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:20.818433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311f1a6-31aa-4f12-954e-9f4349630c27 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:20.826705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0330742-e125-4797-a21f-b8271baae85e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:20.828348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330742-e125-4797-a21f-b8271baae85e service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:20.828748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330742-e125-4797-a21f-b8271baae85e service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:20.829294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330742-e125-4797-a21f-b8271baae85e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:20.839639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330742-e125-4797-a21f-b8271baae85e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:20.842279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330742-e125-4797-a21f-b8271baae85e service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:20.855997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1194/2419] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:24.711658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de0413-b6b1-4d10-be7c-acd38c6f849e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:24.712304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de0413-b6b1-4d10-be7c-acd38c6f849e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:24.712304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de0413-b6b1-4d10-be7c-acd38c6f849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:24.736048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c3de0413-b6b1-4d10-be7c-acd38c6f849e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:24.738174 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c3de0413-b6b1-4d10-be7c-acd38c6f849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:24.749432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1226/2420] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:24.773708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0330742-e125-4797-a21f-b8271baae85e service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:24.790615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0330742-e125-4797-a21f-b8271baae85e service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:24.799881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:24.800937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:24.801474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:24.801949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:24.812703 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:24.814902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:24.828083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1195/2421] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:25.051166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b404e-ca19-46d9-83da-a239562da704 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:25.051455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b404e-ca19-46d9-83da-a239562da704 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:25.051784 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b404e-ca19-46d9-83da-a239562da704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:25.082044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e60b404e-ca19-46d9-83da-a239562da704 None None] MFA Rules not processed for user `391457eb45a646678d4ef035603fb00d`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:25.083256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e60b404e-ca19-46d9-83da-a239562da704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:25.151815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1227/2422] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:02:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:02:25.166051 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:25.167628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:25.182443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb31409-0309-432c-b090-7321e94714c7 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:25.188398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d23edc-bd92-4f52-b47b-60e827c26904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:25.189112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23edc-bd92-4f52-b47b-60e827c26904 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:25.189406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23edc-bd92-4f52-b47b-60e827c26904 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:25.189682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d23edc-bd92-4f52-b47b-60e827c26904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:25.246903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d23edc-bd92-4f52-b47b-60e827c26904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:25.248714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d23edc-bd92-4f52-b47b-60e827c26904 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:25.258982 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1196/2423] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:26.353123 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a49fe-542c-4708-8aab-c8973b305f17 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:26.353653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a49fe-542c-4708-8aab-c8973b305f17 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:26.353653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a49fe-542c-4708-8aab-c8973b305f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:26.360841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:26.375416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e92a49fe-542c-4708-8aab-c8973b305f17 None None] MFA Rules not processed for user `899c4dc4a6264142bcc22acbbe9b12d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:26.376771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e92a49fe-542c-4708-8aab-c8973b305f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:26.384201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1228/2424] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:02:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:29.034998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff55d-9ab7-4b9e-a378-497f0c68b845 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:29.036037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff55d-9ab7-4b9e-a378-497f0c68b845 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:29.036324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff55d-9ab7-4b9e-a378-497f0c68b845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:29.058076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-832ff55d-9ab7-4b9e-a378-497f0c68b845 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:29.059442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-832ff55d-9ab7-4b9e-a378-497f0c68b845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:29.067603 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1197/2425] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:29.094663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a49fe-542c-4708-8aab-c8973b305f17 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:29.107925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a49fe-542c-4708-8aab-c8973b305f17 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:29.113534 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:29.114232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:29.114565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:29.114911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:29.124038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:29.125672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:29.135126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1229/2426] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:32.466907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fbb31-7b57-4952-9ead-ef976c6a2097 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:32.468074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fbb31-7b57-4952-9ead-ef976c6a2097 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:32.468268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fbb31-7b57-4952-9ead-ef976c6a2097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:32.490178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1e5fbb31-7b57-4952-9ead-ef976c6a2097 None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:32.491383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1e5fbb31-7b57-4952-9ead-ef976c6a2097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:32.571322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1198/2427] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:02:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:32.585904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:32.587385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:32.678184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040e860-d6ee-465e-9a1a-41369f8a3cc6 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:32.683924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea4dde-a8d1-4540-90a9-c911a559bd20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:32.684627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea4dde-a8d1-4540-90a9-c911a559bd20 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:32.684912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea4dde-a8d1-4540-90a9-c911a559bd20 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:32.685230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea4dde-a8d1-4540-90a9-c911a559bd20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:32.694185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea4dde-a8d1-4540-90a9-c911a559bd20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:32.695782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea4dde-a8d1-4540-90a9-c911a559bd20 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:32.705120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1230/2428] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:02:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:02:33.173919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c270a30-f239-4760-a929-328cd7bc04e8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:33.174383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c270a30-f239-4760-a929-328cd7bc04e8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:33.174669 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c270a30-f239-4760-a929-328cd7bc04e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:33.197436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5c270a30-f239-4760-a929-328cd7bc04e8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:33.201096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5c270a30-f239-4760-a929-328cd7bc04e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:33.233266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1199/2429] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:33.271195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea4dde-a8d1-4540-90a9-c911a559bd20 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:33.284441 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea4dde-a8d1-4540-90a9-c911a559bd20 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:33.290276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46b098-c625-4dc8-8d4a-1e785a4eacd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:33.290889 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46b098-c625-4dc8-8d4a-1e785a4eacd7 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:33.291179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46b098-c625-4dc8-8d4a-1e785a4eacd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:33.291444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46b098-c625-4dc8-8d4a-1e785a4eacd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:33.300556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46b098-c625-4dc8-8d4a-1e785a4eacd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:33.302185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46b098-c625-4dc8-8d4a-1e785a4eacd7 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:33.315865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1231/2430] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:37.446598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a398f-539f-4aa8-a325-94e3f1d9538e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:37.447197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a398f-539f-4aa8-a325-94e3f1d9538e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:37.447197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a398f-539f-4aa8-a325-94e3f1d9538e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:37.489509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-de8a398f-539f-4aa8-a325-94e3f1d9538e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:37.491322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-de8a398f-539f-4aa8-a325-94e3f1d9538e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:37.503655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1200/2431] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:37.540927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46b098-c625-4dc8-8d4a-1e785a4eacd7 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:37.563915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46b098-c625-4dc8-8d4a-1e785a4eacd7 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:37.570427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735303f-7afc-4067-9c89-52e66005032a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:37.571143 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735303f-7afc-4067-9c89-52e66005032a service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:37.571473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735303f-7afc-4067-9c89-52e66005032a service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:37.571704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735303f-7afc-4067-9c89-52e66005032a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:37.588885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735303f-7afc-4067-9c89-52e66005032a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:37.591651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735303f-7afc-4067-9c89-52e66005032a service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:37.625496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1232/2432] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:43.731707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329744d-c6d7-475f-9d78-50cc95fa7034 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:43.732343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329744d-c6d7-475f-9d78-50cc95fa7034 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:43.732343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329744d-c6d7-475f-9d78-50cc95fa7034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:43.753377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d329744d-c6d7-475f-9d78-50cc95fa7034 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:43.754798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d329744d-c6d7-475f-9d78-50cc95fa7034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:43.763658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1201/2433] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:43.803107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735303f-7afc-4067-9c89-52e66005032a service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:43.835669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735303f-7afc-4067-9c89-52e66005032a service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:43.852883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6faedd-b074-4e00-9343-1bb479e90681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:43.853662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6faedd-b074-4e00-9343-1bb479e90681 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:43.853943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6faedd-b074-4e00-9343-1bb479e90681 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:43.854279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6faedd-b074-4e00-9343-1bb479e90681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:43.870921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6faedd-b074-4e00-9343-1bb479e90681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:43.872541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6faedd-b074-4e00-9343-1bb479e90681 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:43.885694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1233/2434] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:46.279155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329744d-c6d7-475f-9d78-50cc95fa7034 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:46.281861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d329744d-c6d7-475f-9d78-50cc95fa7034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:46.354158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:46.466379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329744d-c6d7-475f-9d78-50cc95fa7034 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:46.472256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a591c-f99f-407a-b044-8e4923bb2dcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:46.473318 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a591c-f99f-407a-b044-8e4923bb2dcf service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:46.473957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a591c-f99f-407a-b044-8e4923bb2dcf service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:46.474471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a591c-f99f-407a-b044-8e4923bb2dcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:46.476421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-af4a591c-f99f-407a-b044-8e4923bb2dcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:46.490054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a591c-f99f-407a-b044-8e4923bb2dcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:46.491853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a591c-f99f-407a-b044-8e4923bb2dcf service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:46.503333 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1202/2435] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:49.511196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a263fa-6856-44da-b053-440ed529f391 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:49.512219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a263fa-6856-44da-b053-440ed529f391 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:49.512694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a263fa-6856-44da-b053-440ed529f391 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:49.515530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1234/2436] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:02:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:49.521851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dafa72-7c4f-4f6e-8794-c1eeb5434718 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:49.522398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dafa72-7c4f-4f6e-8794-c1eeb5434718 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:49.522398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dafa72-7c4f-4f6e-8794-c1eeb5434718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:49.553134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c6dafa72-7c4f-4f6e-8794-c1eeb5434718 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:49.554732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c6dafa72-7c4f-4f6e-8794-c1eeb5434718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:49.567725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1203/2437] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:49.580189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a263fa-6856-44da-b053-440ed529f391 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:49.582468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-06a263fa-6856-44da-b053-440ed529f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:49.650768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a263fa-6856-44da-b053-440ed529f391 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:49.654677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767b9dc-facb-4eb5-ac17-89b055ba3795 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:49.656003 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767b9dc-facb-4eb5-ac17-89b055ba3795 service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:49.656350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767b9dc-facb-4eb5-ac17-89b055ba3795 service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:49.656696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767b9dc-facb-4eb5-ac17-89b055ba3795 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:49.668843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767b9dc-facb-4eb5-ac17-89b055ba3795 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:49.670342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767b9dc-facb-4eb5-ac17-89b055ba3795 service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:49.684351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1235/2438] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:49.757627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47be82-6046-4d0e-ad52-9b025cef8fd4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:49.757920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47be82-6046-4d0e-ad52-9b025cef8fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:49.758223 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47be82-6046-4d0e-ad52-9b025cef8fd4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:49.759591 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1204/2439] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:49.766454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d78a-672a-4840-8681-20e5219bf59d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:49.766768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d78a-672a-4840-8681-20e5219bf59d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:49.767230 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54d78a-672a-4840-8681-20e5219bf59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:49.789177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5e54d78a-672a-4840-8681-20e5219bf59d None None] MFA Rules not processed for user `3a1f548368994994a2966b7818e8b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:49.790478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5e54d78a-672a-4840-8681-20e5219bf59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:49.832941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:02:49.856291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1236/2440] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:02:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:02:49.868235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47be82-6046-4d0e-ad52-9b025cef8fd4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:49.881675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47be82-6046-4d0e-ad52-9b025cef8fd4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:49.885308 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb5306-c028-46e8-b33b-dd104e2e3159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:49.886060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb5306-c028-46e8-b33b-dd104e2e3159 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:49.886339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb5306-c028-46e8-b33b-dd104e2e3159 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:49.886609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb5306-c028-46e8-b33b-dd104e2e3159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:49.894804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb5306-c028-46e8-b33b-dd104e2e3159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:49.896237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb5306-c028-46e8-b33b-dd104e2e3159 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:49.904586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1205/2441] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:02:49.995022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4a3d8-b934-4e8c-81c3-121e3b022eb5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:49.995308 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4a3d8-b934-4e8c-81c3-121e3b022eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:49.995589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4a3d8-b934-4e8c-81c3-121e3b022eb5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:49.997023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1237/2442] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:02:50.002972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbd59-0fb4-4af0-b3d3-dcafd1034854 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:50.003258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbd59-0fb4-4af0-b3d3-dcafd1034854 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:50.003530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fbd59-0fb4-4af0-b3d3-dcafd1034854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:50.026941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d65fbd59-0fb4-4af0-b3d3-dcafd1034854 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:02:50.028161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d65fbd59-0fb4-4af0-b3d3-dcafd1034854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:50.038674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1206/2443] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:02:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:02:50.050551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4a3d8-b934-4e8c-81c3-121e3b022eb5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:02:50.052355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5bf4a3d8-b934-4e8c-81c3-121e3b022eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:02:50.066452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4a3d8-b934-4e8c-81c3-121e3b022eb5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:02:50.070160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680cc6f-c78f-4b41-a827-4ca12706bc99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:02:50.070767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cc6f-c78f-4b41-a827-4ca12706bc99 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:02:50.071048 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cc6f-c78f-4b41-a827-4ca12706bc99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:02:50.071307 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680cc6f-c78f-4b41-a827-4ca12706bc99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:02:50.082517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680cc6f-c78f-4b41-a827-4ca12706bc99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:02:50.083938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680cc6f-c78f-4b41-a827-4ca12706bc99 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:02:50.095369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1238/2444] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:02:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:03:00.021913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=29 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:00.090134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=13 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:03.856360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7ac0-2d24-4d5c-b64f-38890749856b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:03.857256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7ac0-2d24-4d5c-b64f-38890749856b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:03.857691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7ac0-2d24-4d5c-b64f-38890749856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:03.880036 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bc5f7ac0-2d24-4d5c-b64f-38890749856b None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:03.881896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bc5f7ac0-2d24-4d5c-b64f-38890749856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:03.900334 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1207/2445] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:03:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:03.907817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680cc6f-c78f-4b41-a827-4ca12706bc99 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:03.938999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680cc6f-c78f-4b41-a827-4ca12706bc99 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:03.946762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725422dd-5e48-4c31-81db-63b121bb5253 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:03.948128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725422dd-5e48-4c31-81db-63b121bb5253 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:03.948420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725422dd-5e48-4c31-81db-63b121bb5253 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:03.948760 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725422dd-5e48-4c31-81db-63b121bb5253 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:03.957629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725422dd-5e48-4c31-81db-63b121bb5253 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:03.959236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725422dd-5e48-4c31-81db-63b121bb5253 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:03.967505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1239/2446] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:03:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:03:05.007375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bb87-992c-44b9-9aae-699d0baba783 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:05.008290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bb87-992c-44b9-9aae-699d0baba783 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:05.008924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321bb87-992c-44b9-9aae-699d0baba783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:05.032408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8321bb87-992c-44b9-9aae-699d0baba783 None None] MFA Rules not processed for user `b88989c8c53c49afa4e53c72bdcfec80`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:05.034488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8321bb87-992c-44b9-9aae-699d0baba783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:05.105453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1208/2447] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:07.115000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219359-814d-491c-a166-e26af5143f3f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:07.115618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219359-814d-491c-a166-e26af5143f3f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:07.115618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30219359-814d-491c-a166-e26af5143f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:07.137859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-30219359-814d-491c-a166-e26af5143f3f None None] MFA Rules not processed for user `912b5f1275fb43dfb1c0a9c47ecb3fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:07.139207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-30219359-814d-491c-a166-e26af5143f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:07.204699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1240/2448] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:03:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:15.098413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=28 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:17.193371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=31 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:17.238757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321bb87-992c-44b9-9aae-699d0baba783 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:17.253238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321bb87-992c-44b9-9aae-699d0baba783 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:17.276806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02f7bb-95b1-433f-a680-cf8fe27fc349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:17.277910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02f7bb-95b1-433f-a680-cf8fe27fc349 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:17.279803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02f7bb-95b1-433f-a680-cf8fe27fc349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:17.280389 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02f7bb-95b1-433f-a680-cf8fe27fc349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:17.316116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02f7bb-95b1-433f-a680-cf8fe27fc349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:17.318272 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02f7bb-95b1-433f-a680-cf8fe27fc349 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:17.336075 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1209/2449] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:03:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:03:21.773805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059480bd-60a4-44c2-ad3f-0d08dbc04b87 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:21.774720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059480bd-60a4-44c2-ad3f-0d08dbc04b87 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:21.774997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059480bd-60a4-44c2-ad3f-0d08dbc04b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:21.798572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-059480bd-60a4-44c2-ad3f-0d08dbc04b87 None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:21.799864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-059480bd-60a4-44c2-ad3f-0d08dbc04b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:21.818346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1241/2450] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 10 12:03:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:21.840356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02f7bb-95b1-433f-a680-cf8fe27fc349 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:21.852264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02f7bb-95b1-433f-a680-cf8fe27fc349 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:21.857528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c5474-fef4-497e-9f95-e080e2f286db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:21.858133 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5474-fef4-497e-9f95-e080e2f286db service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:21.858411 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5474-fef4-497e-9f95-e080e2f286db service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:21.858884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5474-fef4-497e-9f95-e080e2f286db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:21.868206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c5474-fef4-497e-9f95-e080e2f286db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:21.869829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c5474-fef4-497e-9f95-e080e2f286db service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:21.879737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1210/2451] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:03:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:03:31.791672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:31.876007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=12 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:03:37.222277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f551-19a8-4459-acb3-0c71ddbc711f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:37.222788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f551-19a8-4459-acb3-0c71ddbc711f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:37.222788 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743f551-19a8-4459-acb3-0c71ddbc711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:37.242171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a743f551-19a8-4459-acb3-0c71ddbc711f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:37.243349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a743f551-19a8-4459-acb3-0c71ddbc711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:37.250904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1242/2452] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:37.276309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c5474-fef4-497e-9f95-e080e2f286db service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:37.288058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c5474-fef4-497e-9f95-e080e2f286db service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:37.293576 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c1d7a-6a10-4948-a076-b88a3ac9b358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:37.294161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1d7a-6a10-4948-a076-b88a3ac9b358 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:37.294459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1d7a-6a10-4948-a076-b88a3ac9b358 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:37.294711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1d7a-6a10-4948-a076-b88a3ac9b358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:37.303258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1d7a-6a10-4948-a076-b88a3ac9b358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:37.304843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1d7a-6a10-4948-a076-b88a3ac9b358 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:37.315244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1211/2453] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:03:40.461051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490676cb-126e-420e-8603-1b045a9fe0b2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:40.461624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490676cb-126e-420e-8603-1b045a9fe0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:40.461624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490676cb-126e-420e-8603-1b045a9fe0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:40.481811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-490676cb-126e-420e-8603-1b045a9fe0b2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:40.483138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-490676cb-126e-420e-8603-1b045a9fe0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:40.492034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1243/2454] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:40.535621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c1d7a-6a10-4948-a076-b88a3ac9b358 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:40.547031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c1d7a-6a10-4948-a076-b88a3ac9b358 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:40.554107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1664481-67ee-40a2-a4b0-a1e723a647a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:40.554709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1664481-67ee-40a2-a4b0-a1e723a647a5 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:40.554994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1664481-67ee-40a2-a4b0-a1e723a647a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:40.555269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1664481-67ee-40a2-a4b0-a1e723a647a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:40.564021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1664481-67ee-40a2-a4b0-a1e723a647a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:40.565634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1664481-67ee-40a2-a4b0-a1e723a647a5 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:40.574811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1212/2455] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:03:44.552122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb813-ac82-467b-9903-2262878cb0a7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:44.552651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb813-ac82-467b-9903-2262878cb0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:44.552770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bb813-ac82-467b-9903-2262878cb0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:44.574312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ab1bb813-ac82-467b-9903-2262878cb0a7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:44.575431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ab1bb813-ac82-467b-9903-2262878cb0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:44.584122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1244/2456] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:44.608587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1664481-67ee-40a2-a4b0-a1e723a647a5 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:44.621769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1664481-67ee-40a2-a4b0-a1e723a647a5 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:44.628670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb7cf2-ca52-4d6f-9f3a-02eef8cec651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:44.629316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7cf2-ca52-4d6f-9f3a-02eef8cec651 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:44.629597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7cf2-ca52-4d6f-9f3a-02eef8cec651 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:44.629869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb7cf2-ca52-4d6f-9f3a-02eef8cec651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:44.638624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb7cf2-ca52-4d6f-9f3a-02eef8cec651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:44.640208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb7cf2-ca52-4d6f-9f3a-02eef8cec651 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:44.649981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1213/2457] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:03:45.200964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f2c8b-3131-4275-9288-734163966ec4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:45.201284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f2c8b-3131-4275-9288-734163966ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:45.201559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f2c8b-3131-4275-9288-734163966ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:45.220447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-305f2c8b-3131-4275-9288-734163966ec4 None None] MFA Rules not processed for user `8fdf7fcf986c43b895e4c76c4dd2adff`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:45.221655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-305f2c8b-3131-4275-9288-734163966ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:45.277255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1245/2458] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:03:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:48.728803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468250a2-5cdf-4fca-bcf3-59c604fd5a97 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:48.729317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468250a2-5cdf-4fca-bcf3-59c604fd5a97 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:48.729434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468250a2-5cdf-4fca-bcf3-59c604fd5a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:48.748680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-468250a2-5cdf-4fca-bcf3-59c604fd5a97 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:48.749892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-468250a2-5cdf-4fca-bcf3-59c604fd5a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:48.757562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1214/2459] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:48.809237 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f2c8b-3131-4275-9288-734163966ec4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:48.822034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f2c8b-3131-4275-9288-734163966ec4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:48.827325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f134fa9-7bf7-48bf-8537-8ecbfedd0847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:48.827952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134fa9-7bf7-48bf-8537-8ecbfedd0847 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:48.828231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134fa9-7bf7-48bf-8537-8ecbfedd0847 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:48.828502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134fa9-7bf7-48bf-8537-8ecbfedd0847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:48.836432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f134fa9-7bf7-48bf-8537-8ecbfedd0847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:48.838038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f134fa9-7bf7-48bf-8537-8ecbfedd0847 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:48.847177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1246/2460] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:03:54.973110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896533a7-f3b1-4549-bdfb-f552d790910c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:54.973612 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896533a7-f3b1-4549-bdfb-f552d790910c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:54.973721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896533a7-f3b1-4549-bdfb-f552d790910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:54.993203 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-896533a7-f3b1-4549-bdfb-f552d790910c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:03:54.994393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-896533a7-f3b1-4549-bdfb-f552d790910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:03:55.002153 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1215/2461] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 10 12:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:03:55.033737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f134fa9-7bf7-48bf-8537-8ecbfedd0847 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:03:55.045435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f134fa9-7bf7-48bf-8537-8ecbfedd0847 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:03:55.050855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95213e-8186-4dae-82a7-90f14a709215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:03:55.051449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95213e-8186-4dae-82a7-90f14a709215 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:03:55.051731 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95213e-8186-4dae-82a7-90f14a709215 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:03:55.052054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95213e-8186-4dae-82a7-90f14a709215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:03:55.059983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95213e-8186-4dae-82a7-90f14a709215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:03:55.061588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95213e-8186-4dae-82a7-90f14a709215 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:03:55.071334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1247/2462] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:04:04.988498 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=24 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:05.067002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=46 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:21.421251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c51a5-30c6-44e0-8ec3-b31ee2d5c23a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:21.421763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c51a5-30c6-44e0-8ec3-b31ee2d5c23a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:21.421858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c51a5-30c6-44e0-8ec3-b31ee2d5c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:21.440384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9e8c51a5-30c6-44e0-8ec3-b31ee2d5c23a None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:21.441875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9e8c51a5-30c6-44e0-8ec3-b31ee2d5c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:21.449517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1216/2463] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 10 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:21.498059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95213e-8186-4dae-82a7-90f14a709215 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:21.509209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95213e-8186-4dae-82a7-90f14a709215 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:21.514990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b316-b719-4f3e-a10b-cf5aee1ccec7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:21.515597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b316-b719-4f3e-a10b-cf5aee1ccec7 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:21.515877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b316-b719-4f3e-a10b-cf5aee1ccec7 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:21.516151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b316-b719-4f3e-a10b-cf5aee1ccec7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:21.524316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b316-b719-4f3e-a10b-cf5aee1ccec7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:21.525938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b316-b719-4f3e-a10b-cf5aee1ccec7 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:21.534576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1248/2464] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:04:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:04:23.964028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461939-dfb3-4a30-ab89-bfbcfaede155 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:23.964532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461939-dfb3-4a30-ab89-bfbcfaede155 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:23.964718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82461939-dfb3-4a30-ab89-bfbcfaede155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:23.987363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-82461939-dfb3-4a30-ab89-bfbcfaede155 None None] MFA Rules not processed for user `549d0ae567994dc5b58f24fbb614363b`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:23.988787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-82461939-dfb3-4a30-ab89-bfbcfaede155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:24.061042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1217/2465] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:25.519367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db10a-a6cf-4949-a20f-bae525828f07 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:25.519896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db10a-a6cf-4949-a20f-bae525828f07 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:25.519982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5db10a-a6cf-4949-a20f-bae525828f07 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:25.521392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1249/2466] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:04:25.531943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff526a-2c38-47cb-9b77-146d7c9420b5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:25.532469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff526a-2c38-47cb-9b77-146d7c9420b5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:25.532469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff526a-2c38-47cb-9b77-146d7c9420b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:25.561952 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-04ff526a-2c38-47cb-9b77-146d7c9420b5 None None] MFA Rules not processed for user `397ce721f9684753b304f5c3b96c8a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:25.563302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-04ff526a-2c38-47cb-9b77-146d7c9420b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:25.572827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1218/2467] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:25.585648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5db10a-a6cf-4949-a20f-bae525828f07 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:25.587568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7d5db10a-a6cf-4949-a20f-bae525828f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:25.610849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5db10a-a6cf-4949-a20f-bae525828f07 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:25.621125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69e5a-c024-408a-b73b-cf21c823f61b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:25.621746 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69e5a-c024-408a-b73b-cf21c823f61b service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:25.622026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69e5a-c024-408a-b73b-cf21c823f61b service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:25.622299 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf69e5a-c024-408a-b73b-cf21c823f61b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:25.631827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf69e5a-c024-408a-b73b-cf21c823f61b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:25.633481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf69e5a-c024-408a-b73b-cf21c823f61b service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:25.643845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1250/2468] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:04:27.220638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff526a-2c38-47cb-9b77-146d7c9420b5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:27.222613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-04ff526a-2c38-47cb-9b77-146d7c9420b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:27.240788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff526a-2c38-47cb-9b77-146d7c9420b5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:27.249381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:27.250180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:27.250983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:27.252088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] PATH_INFO: `/v3/users/b88989c8c53c49afa4e53c72bdcfec80` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:27.253870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88989c8c53c49afa4e53c72bdcfec80)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:27.257516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:27.344792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88989c8c53c49afa4e53c72bdcfec80'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:27.360659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88989c8c53c49afa4e53c72bdcfec80'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:27.361721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88989c8c53c49afa4e53c72bdcfec80'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:27.372139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88989c8c53c49afa4e53c72bdcfec80'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:27.373309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f99fa724-a4c6-42a5-86f4-e1c566edb53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88989c8c53c49afa4e53c72bdcfec80'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:27.390881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1219/2469] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:04:27 2022] DELETE /identity/v3/users/b88989c8c53c49afa4e53c72bdcfec80 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:27.790421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69e5a-c024-408a-b73b-cf21c823f61b service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:27.801611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf69e5a-c024-408a-b73b-cf21c823f61b service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:27.880310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:27.880954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:27.881432 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:27.881939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] PATH_INFO: `/v3/projects/897365ac5a174c34b939103e84afe363` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:27.883243 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897365ac5a174c34b939103e84afe363)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:27.885379 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:27.942549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897365ac5a174c34b939103e84afe363', 'request_id': 'req-0835d672-1dcc-4765-b88d-ec39ee466575'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:27.951555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897365ac5a174c34b939103e84afe363', 'request_id': 'req-0835d672-1dcc-4765-b88d-ec39ee466575'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:27.966577 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897365ac5a174c34b939103e84afe363', 'request_id': 'req-0835d672-1dcc-4765-b88d-ec39ee466575'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:27.999036 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] The token cache is being invalidate because project 897365ac5a174c34b939103e84afe363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:04:28.000314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:28.002430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0835d672-1dcc-4765-b88d-ec39ee466575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:28.006101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1251/2470] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:04:27 2022] DELETE /identity/v3/projects/897365ac5a174c34b939103e84afe363 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:28.013023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732967b-4361-4f55-8fd1-ebb3aa447964 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.013322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732967b-4361-4f55-8fd1-ebb3aa447964 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.013614 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732967b-4361-4f55-8fd1-ebb3aa447964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.060262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d732967b-4361-4f55-8fd1-ebb3aa447964 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:28.066337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d732967b-4361-4f55-8fd1-ebb3aa447964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:28.163146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1220/2471] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:28.170805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d82c9-5156-46e8-b377-dec0776a0fa2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.171329 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d82c9-5156-46e8-b377-dec0776a0fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.172218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d82c9-5156-46e8-b377-dec0776a0fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.195964 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-249d82c9-5156-46e8-b377-dec0776a0fa2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:28.197548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-249d82c9-5156-46e8-b377-dec0776a0fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:28.208868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1252/2472] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:28.212911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732967b-4361-4f55-8fd1-ebb3aa447964 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:28.219624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:28.224340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732967b-4361-4f55-8fd1-ebb3aa447964 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:28.238634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:28.239469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.239822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.240205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.240931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:04:28.241483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:28.246046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:28.265583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1221/2473] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:04:28.273910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d82c9-5156-46e8-b377-dec0776a0fa2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:28.285490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d82c9-5156-46e8-b377-dec0776a0fa2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:28.291455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b221-2cd6-45ac-be19-11199469f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:28.292112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b221-2cd6-45ac-be19-11199469f06a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.292928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b221-2cd6-45ac-be19-11199469f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.293503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b221-2cd6-45ac-be19-11199469f06a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.294139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8b221-2cd6-45ac-be19-11199469f06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:28.296103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8b221-2cd6-45ac-be19-11199469f06a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:28.355930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1253/2474] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:04:28 2022] POST /identity/v3/projects => generated 397 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:04:28.360312 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:28.376805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46dfab-725a-415e-805d-a72d1879f326 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:28.523062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135a725-f641-4df5-8892-9bea529e84b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:28.523692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a725-f641-4df5-8892-9bea529e84b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.524332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a725-f641-4df5-8892-9bea529e84b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.524782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a725-f641-4df5-8892-9bea529e84b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.525847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135a725-f641-4df5-8892-9bea529e84b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:28.528266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135a725-f641-4df5-8892-9bea529e84b1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:28.584790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1222/2475] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:04:28 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:04:28.589761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b221-2cd6-45ac-be19-11199469f06a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:28.607627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b221-2cd6-45ac-be19-11199469f06a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:28.628619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ab76a-bb5c-4bf0-9d99-a57de9bf264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:28.630862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab76a-bb5c-4bf0-9d99-a57de9bf264b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.632231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab76a-bb5c-4bf0-9d99-a57de9bf264b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.633137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab76a-bb5c-4bf0-9d99-a57de9bf264b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.635210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ab76a-bb5c-4bf0-9d99-a57de9bf264b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:28.640225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ab76a-bb5c-4bf0-9d99-a57de9bf264b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:28.665558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1254/2476] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:04:28.665693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135a725-f641-4df5-8892-9bea529e84b1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:28.672684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135a725-f641-4df5-8892-9bea529e84b1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:28.691076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6196c-ac58-4467-b1e3-e4ac420539a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:28.692259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6196c-ac58-4467-b1e3-e4ac420539a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.692597 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6196c-ac58-4467-b1e3-e4ac420539a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.693000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6196c-ac58-4467-b1e3-e4ac420539a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.693773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6196c-ac58-4467-b1e3-e4ac420539a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:28.695566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6196c-ac58-4467-b1e3-e4ac420539a8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:28.725067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1223/2477] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:04:28.726825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ab76a-bb5c-4bf0-9d99-a57de9bf264b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:28.741179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ab76a-bb5c-4bf0-9d99-a57de9bf264b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:28.750983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:28.751927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.752256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.752708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] PATH_INFO: `/v3/projects/c76149d4ed1e4c5f9b5c5cbcc7b8942d/users/18d995b85a3a43c4bf3c1fef1f331c94/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.788010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76149d4ed1e4c5f9b5c5cbcc7b8942d, user_id=18d995b85a3a43c4bf3c1fef1f331c94, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:28.791970 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:28.821865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:28.839841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1255/2478] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:04:28 2022] PUT /identity/v3/projects/c76149d4ed1e4c5f9b5c5cbcc7b8942d/users/18d995b85a3a43c4bf3c1fef1f331c94/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:28.841999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba241-8abc-4b24-9502-73165143ec28 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:28.842288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba241-8abc-4b24-9502-73165143ec28 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:28.842565 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcba241-8abc-4b24-9502-73165143ec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:28.915192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4bcba241-8abc-4b24-9502-73165143ec28 None None] MFA Rules not processed for user `18d995b85a3a43c4bf3c1fef1f331c94`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:28.916554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4bcba241-8abc-4b24-9502-73165143ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:29.032635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1224/2479] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:29.046399 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:29.048322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:29.127206 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caea58-5327-4e74-8dc0-6c4d3945f2c8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:29.132615 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c2d2-340b-468a-909a-193059554256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:29.133610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c2d2-340b-468a-909a-193059554256 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:29.134134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c2d2-340b-468a-909a-193059554256 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:29.134755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65c2d2-340b-468a-909a-193059554256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:29.147031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c2d2-340b-468a-909a-193059554256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:29.148798 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65c2d2-340b-468a-909a-193059554256 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:29.159469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1256/2480] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:04:29.577483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba241-8abc-4b24-9502-73165143ec28 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:29.578675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4bcba241-8abc-4b24-9502-73165143ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:29.684585 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcba241-8abc-4b24-9502-73165143ec28 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:29.689511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:29.690783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:29.690783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:29.691047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] PATH_INFO: `/v3/users/f61f3182cb9d48d0ba6f417e2afb0809` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:29.692469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61f3182cb9d48d0ba6f417e2afb0809)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:29.694464 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:29.696290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:29.764814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61f3182cb9d48d0ba6f417e2afb0809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:29.778217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61f3182cb9d48d0ba6f417e2afb0809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:29.778957 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61f3182cb9d48d0ba6f417e2afb0809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:29.786945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61f3182cb9d48d0ba6f417e2afb0809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:29.787586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61f3182cb9d48d0ba6f417e2afb0809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:29.809359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1225/2481] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:04:29 2022] DELETE /identity/v3/users/f61f3182cb9d48d0ba6f417e2afb0809 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:29.987190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c2d2-340b-468a-909a-193059554256 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:30.005745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65c2d2-340b-468a-909a-193059554256 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:30.063049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:30.063653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:30.063930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:30.064201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] PATH_INFO: `/v3/projects/8f61594c21634d828c377fb7be724b52` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.065322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f61594c21634d828c377fb7be724b52)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:30.067476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:30.113650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f61594c21634d828c377fb7be724b52', 'request_id': 'req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.118994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f61594c21634d828c377fb7be724b52', 'request_id': 'req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.125347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f61594c21634d828c377fb7be724b52', 'request_id': 'req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.137438 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] The token cache is being invalidate because project 8f61594c21634d828c377fb7be724b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:04:30.137727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.138330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.139809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1257/2482] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:04:29 2022] DELETE /identity/v3/projects/8f61594c21634d828c377fb7be724b52 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:30.143790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:30.145278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:30.158662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8757f-9638-491d-b92c-76de02ccedda admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:30.215254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:30.215903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:30.216181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:30.216455 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] PATH_INFO: `/v3/users/ce1be25f669340b6b386384ee8970778` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.217659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce1be25f669340b6b386384ee8970778)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:30.219619 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:30.265720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce1be25f669340b6b386384ee8970778'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.277864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce1be25f669340b6b386384ee8970778'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.278530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce1be25f669340b6b386384ee8970778'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.285817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce1be25f669340b6b386384ee8970778'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.286437 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce1be25f669340b6b386384ee8970778'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.294278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:30.299921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1226/2483] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:04:30 2022] DELETE /identity/v3/users/ce1be25f669340b6b386384ee8970778 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:30.474112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:30.475610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:30.490980 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e1a3-eba4-4778-8b6a-c9d0a13696e4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:30.521983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:30.554209 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:30.554868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:30.555199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:30.555426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] PATH_INFO: `/v3/projects/5f098a73bfb14061addc4fbf1025f5cb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:30.556612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f098a73bfb14061addc4fbf1025f5cb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:30.559278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:30.637464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f098a73bfb14061addc4fbf1025f5cb', 'request_id': 'req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.644341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f098a73bfb14061addc4fbf1025f5cb', 'request_id': 'req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.651265 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f098a73bfb14061addc4fbf1025f5cb', 'request_id': 'req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.665565 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] The token cache is being invalidate because project 5f098a73bfb14061addc4fbf1025f5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:04:30.665874 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.666597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:30.668761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1258/2484] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:04:30 2022] DELETE /identity/v3/projects/5f098a73bfb14061addc4fbf1025f5cb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:32.203387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:32.205060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:32.278155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95ae8c-0f57-406b-bab9-821c58676629 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:32.326027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f31f-8f4d-4721-b565-193e95ac5bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:32.326560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f31f-8f4d-4721-b565-193e95ac5bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:32.326837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f31f-8f4d-4721-b565-193e95ac5bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:32.327106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f31f-8f4d-4721-b565-193e95ac5bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:32.328925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d292f31f-8f4d-4721-b565-193e95ac5bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:32.401548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f31f-8f4d-4721-b565-193e95ac5bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:32.403593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f31f-8f4d-4721-b565-193e95ac5bd4 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:32.415753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1227/2485] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:04:34.409454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:34.411722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:34.487960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3af05e-b9a8-4545-a7a4-4f3c0e450495 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:34.492576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:34.493238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:34.493514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:34.493789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] PATH_INFO: `/v3/users/18d995b85a3a43c4bf3c1fef1f331c94` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:34.494934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d995b85a3a43c4bf3c1fef1f331c94)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:34.497505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:34.562450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d995b85a3a43c4bf3c1fef1f331c94'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:34.590916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d995b85a3a43c4bf3c1fef1f331c94'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:34.591775 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d995b85a3a43c4bf3c1fef1f331c94'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:34.594190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:34.606028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d995b85a3a43c4bf3c1fef1f331c94'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:34.612072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d995b85a3a43c4bf3c1fef1f331c94'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:34.626910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1259/2486] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:04:34 2022] DELETE /identity/v3/users/18d995b85a3a43c4bf3c1fef1f331c94 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:34.631528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc598c-1932-46bf-8571-8de869d3ddf9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:34.632044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc598c-1932-46bf-8571-8de869d3ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:34.632245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc598c-1932-46bf-8571-8de869d3ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:34.654761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-addc598c-1932-46bf-8571-8de869d3ddf9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:34.656029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-addc598c-1932-46bf-8571-8de869d3ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:34.728852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:34.745124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1228/2487] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:04:34.752001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:34.752311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc598c-1932-46bf-8571-8de869d3ddf9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:34.753851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-addc598c-1932-46bf-8571-8de869d3ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:34.759195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:34.831009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc598c-1932-46bf-8571-8de869d3ddf9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:34.834683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:34.835297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:34.835580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:34.835857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:34.842848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588481-b893-4724-95b9-96181502fb2c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:34.847089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:34.847956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:34.848573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:34.848711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:34.848904 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:34.849128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:34.858067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:34.861950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1229/2488] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:04:34.935878 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:34.937355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:34.948890 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1260/2489] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:04:35.200105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:35.202369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:35.220558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d6285-5b6e-48cd-aa7e-897bf07c9adb service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:35.226520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:35.227390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:35.227794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:35.228181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] PATH_INFO: `/v3/projects/c76149d4ed1e4c5f9b5c5cbcc7b8942d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:35.233159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76149d4ed1e4c5f9b5c5cbcc7b8942d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:35.233159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:35.280454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76149d4ed1e4c5f9b5c5cbcc7b8942d', 'request_id': 'req-02639725-375e-4f8c-b663-d43f544f135e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:35.286253 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76149d4ed1e4c5f9b5c5cbcc7b8942d', 'request_id': 'req-02639725-375e-4f8c-b663-d43f544f135e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:35.292317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76149d4ed1e4c5f9b5c5cbcc7b8942d', 'request_id': 'req-02639725-375e-4f8c-b663-d43f544f135e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:35.304247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] The token cache is being invalidate because project c76149d4ed1e4c5f9b5c5cbcc7b8942d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:04:35.304540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:35.305262 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-02639725-375e-4f8c-b663-d43f544f135e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:04:35.306738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1230/2490] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:04:35 2022] DELETE /identity/v3/projects/c76149d4ed1e4c5f9b5c5cbcc7b8942d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:04:44.545517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:44.548262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:44.582778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e0ad-787c-4841-9ab5-12a1115e2947 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:44.664576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:44.665634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:44.666085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:44.667294 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:44.670023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:44.697934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:44.754571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:44.756509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:44.776812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1261/2491] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:04:45.301876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:45.396616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65886-4881-4207-8ba8-98768126b1fb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:45.396908 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65886-4881-4207-8ba8-98768126b1fb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:45.397220 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac65886-4881-4207-8ba8-98768126b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:45.416123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9ac65886-4881-4207-8ba8-98768126b1fb None None] MFA Rules not processed for user `912b5f1275fb43dfb1c0a9c47ecb3fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:04:45.417371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9ac65886-4881-4207-8ba8-98768126b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:45.477104 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1231/2492] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:04:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:04:48.430797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:48.432882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:48.492732 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ea399-e70b-4dd7-919f-a45cf8fd3e61 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:48.496434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:48.497094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:48.497439 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:48.497714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:48.499580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:48.510609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:48.512031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:48.521804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1262/2493] 10.222.0.45 () {60 vars in 1396 bytes} [Mon Oct 10 12:04:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:04:55.470313 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=25 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:58.517295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=44 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:04:59.207047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac65886-4881-4207-8ba8-98768126b1fb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:04:59.208460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9ac65886-4881-4207-8ba8-98768126b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:59.220749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac65886-4881-4207-8ba8-98768126b1fb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:04:59.224350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:04:59.224944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:04:59.225260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:04:59.225532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:04:59.227181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:04:59.289478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:04:59.290895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:04:59.300965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1232/2494] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:01.202417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:01.212078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36aa0-1802-4bd4-9430-2a5d24163c08 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:01.217444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:01.218178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:01.218561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:01.218941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:01.221510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:01.238111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:01.240196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:01.261417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1263/2495] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:03.029316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.030865 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:03.045665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d376470-853c-4c6c-9a60-be8337d831f2 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:03.051085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:03.051723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.052002 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.052280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] PATH_INFO: `/v3/users/8fdf7fcf986c43b895e4c76c4dd2adff` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.053478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdf7fcf986c43b895e4c76c4dd2adff)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:03.055394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:03.103046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdf7fcf986c43b895e4c76c4dd2adff'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.115167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdf7fcf986c43b895e4c76c4dd2adff'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.115835 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdf7fcf986c43b895e4c76c4dd2adff'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.123901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdf7fcf986c43b895e4c76c4dd2adff'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.124571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2c76688c-cde3-4c40-b514-16e42c9908c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdf7fcf986c43b895e4c76c4dd2adff'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.137853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1233/2496] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:05:03 2022] DELETE /identity/v3/users/8fdf7fcf986c43b895e4c76c4dd2adff => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:05:03.307349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.319765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721eb6b-96e6-40cc-b44b-dd5f55eb5c35 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:03.376474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:03.377190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.377474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.377748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] PATH_INFO: `/v3/projects/fac6423f314145cb931be79b845b12e1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.378887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac6423f314145cb931be79b845b12e1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:03.380814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:03.425882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac6423f314145cb931be79b845b12e1', 'request_id': 'req-ee63914b-783e-4a11-8e23-86e133e9770e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.431343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac6423f314145cb931be79b845b12e1', 'request_id': 'req-ee63914b-783e-4a11-8e23-86e133e9770e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.437354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac6423f314145cb931be79b845b12e1', 'request_id': 'req-ee63914b-783e-4a11-8e23-86e133e9770e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.449499 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] The token cache is being invalidate because project fac6423f314145cb931be79b845b12e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:05:03.449790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.450414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ee63914b-783e-4a11-8e23-86e133e9770e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:03.451876 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1264/2497] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:05:03 2022] DELETE /identity/v3/projects/fac6423f314145cb931be79b845b12e1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:05:03.456863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3134e-6518-4b88-9bbb-1a51fd18cd90 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.457189 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3134e-6518-4b88-9bbb-1a51fd18cd90 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.457466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3134e-6518-4b88-9bbb-1a51fd18cd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.478744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1ac3134e-6518-4b88-9bbb-1a51fd18cd90 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:03.479941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1ac3134e-6518-4b88-9bbb-1a51fd18cd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:03.536774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1234/2498] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:03.544252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ce13b-e0e1-40a9-8a1b-75c48e941a2f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.544541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ce13b-e0e1-40a9-8a1b-75c48e941a2f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.544825 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ce13b-e0e1-40a9-8a1b-75c48e941a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.565227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-345ce13b-e0e1-40a9-8a1b-75c48e941a2f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:03.566440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-345ce13b-e0e1-40a9-8a1b-75c48e941a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:03.574532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1265/2499] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:03.578616 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3134e-6518-4b88-9bbb-1a51fd18cd90 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.588183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3134e-6518-4b88-9bbb-1a51fd18cd90 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:03.592882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:03.594027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.594302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.595048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.595696 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:05:03.595997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:03.597604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:03.599007 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:03.612338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1235/2500] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:05:03.616497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ce13b-e0e1-40a9-8a1b-75c48e941a2f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.625611 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ce13b-e0e1-40a9-8a1b-75c48e941a2f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:03.630296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496fbaf-002c-49fd-ba2f-3e23c29446f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:03.630885 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496fbaf-002c-49fd-ba2f-3e23c29446f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.631164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496fbaf-002c-49fd-ba2f-3e23c29446f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.631433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496fbaf-002c-49fd-ba2f-3e23c29446f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.632065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496fbaf-002c-49fd-ba2f-3e23c29446f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:03.634001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496fbaf-002c-49fd-ba2f-3e23c29446f0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:03.661599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1266/2501] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:05:03 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:05:03.665951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.676433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537381-b5c8-48ce-a3fc-0d68c7d816aa admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:03.730998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13b755-e85d-46bd-a72a-5f60ce057d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:03.731889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b755-e85d-46bd-a72a-5f60ce057d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.732173 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b755-e85d-46bd-a72a-5f60ce057d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.732444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b755-e85d-46bd-a72a-5f60ce057d53 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.733101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13b755-e85d-46bd-a72a-5f60ce057d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:03.735644 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13b755-e85d-46bd-a72a-5f60ce057d53 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:03.756181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1236/2502] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:05:03 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:05:03.760160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496fbaf-002c-49fd-ba2f-3e23c29446f0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.770166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496fbaf-002c-49fd-ba2f-3e23c29446f0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:03.774761 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cadc5-424d-475f-9e07-106b0b1237e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:03.775352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cadc5-424d-475f-9e07-106b0b1237e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.775638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cadc5-424d-475f-9e07-106b0b1237e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.775909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cadc5-424d-475f-9e07-106b0b1237e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.776541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cadc5-424d-475f-9e07-106b0b1237e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:03.778154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cadc5-424d-475f-9e07-106b0b1237e8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:03.788655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1267/2503] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:05:03.792276 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13b755-e85d-46bd-a72a-5f60ce057d53 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.802469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13b755-e85d-46bd-a72a-5f60ce057d53 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:03.807321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c088714-ebb6-4cc2-b3ce-1f76315e1791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:03.807921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c088714-ebb6-4cc2-b3ce-1f76315e1791 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.808205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c088714-ebb6-4cc2-b3ce-1f76315e1791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.808478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c088714-ebb6-4cc2-b3ce-1f76315e1791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.809167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c088714-ebb6-4cc2-b3ce-1f76315e1791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:03.810765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c088714-ebb6-4cc2-b3ce-1f76315e1791 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:03.822679 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1237/2504] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:05:03.826860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cadc5-424d-475f-9e07-106b0b1237e8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.837403 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cadc5-424d-475f-9e07-106b0b1237e8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:03.842160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:03.842800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.843081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.843919 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] PATH_INFO: `/v3/projects/b10da9e8a7f74d0e8df34fe02393ce31/users/abe38c7883ad4092a2bbcbdd41f0b809/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.859354 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10da9e8a7f74d0e8df34fe02393ce31, user_id=abe38c7883ad4092a2bbcbdd41f0b809, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:03.862064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:03.874594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1268/2505] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:05:03 2022] PUT /identity/v3/projects/b10da9e8a7f74d0e8df34fe02393ce31/users/abe38c7883ad4092a2bbcbdd41f0b809/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:05:03.879750 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b3ac2-5276-4335-b75e-ab04240839d1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:03.880040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b3ac2-5276-4335-b75e-ab04240839d1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:03.880314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b3ac2-5276-4335-b75e-ab04240839d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:03.899430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-af7b3ac2-5276-4335-b75e-ab04240839d1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:03.900622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-af7b3ac2-5276-4335-b75e-ab04240839d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:03.958175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1238/2506] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:03.967701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:03.969978 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:03.984068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:04.026949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b24875-ec5e-4901-83f9-6831aecba971 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:04.030639 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:04.031815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:04.032096 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:04.032369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:04.041272 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:04.042632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:04.051902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1269/2507] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:07.913946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bf6c4-9a37-4e19-89f8-4dbe8f2a3c7c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:07.914494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bf6c4-9a37-4e19-89f8-4dbe8f2a3c7c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:07.914632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bf6c4-9a37-4e19-89f8-4dbe8f2a3c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:07.943449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d83bf6c4-9a37-4e19-89f8-4dbe8f2a3c7c None None] MFA Rules not processed for user `abe38c7883ad4092a2bbcbdd41f0b809`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:07.944594 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d83bf6c4-9a37-4e19-89f8-4dbe8f2a3c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:08.017778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1239/2508] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:05:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:08.032302 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:08.033815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:08.108196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52950264-93fb-4f00-b5fd-d989696744d2 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:08.113640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde715-f67a-4332-9e01-396c06a81798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:08.114246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde715-f67a-4332-9e01-396c06a81798 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:08.114523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde715-f67a-4332-9e01-396c06a81798 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:08.114793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fde715-f67a-4332-9e01-396c06a81798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:08.122696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fde715-f67a-4332-9e01-396c06a81798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:08.124306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fde715-f67a-4332-9e01-396c06a81798 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:08.134895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1270/2509] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:09.733129 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029ed2-74c6-47e8-9f79-12deaa6e0973 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:09.733586 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029ed2-74c6-47e8-9f79-12deaa6e0973 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:09.733808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46029ed2-74c6-47e8-9f79-12deaa6e0973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:09.741716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:09.757463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-46029ed2-74c6-47e8-9f79-12deaa6e0973 None None] MFA Rules not processed for user `abe38c7883ad4092a2bbcbdd41f0b809`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:09.758730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-46029ed2-74c6-47e8-9f79-12deaa6e0973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:09.765823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1240/2510] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:05:10.084882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde715-f67a-4332-9e01-396c06a81798 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:10.095349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fde715-f67a-4332-9e01-396c06a81798 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:10.098908 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:10.099510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:10.099782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:10.100051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:10.101776 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:10.111283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:10.112683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:10.120604 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1271/2511] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:05:10.435892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46029ed2-74c6-47e8-9f79-12deaa6e0973 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:10.437914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-46029ed2-74c6-47e8-9f79-12deaa6e0973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:10.520174 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46029ed2-74c6-47e8-9f79-12deaa6e0973 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:10.525266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:10.525884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:10.526168 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:10.526444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:10.528212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:10.543702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:10.545329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:10.556094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1241/2512] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:13.419795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:13.421394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:13.439840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9993b9-0751-4bac-abdc-10c49b36285f service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:13.446115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:13.446724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:13.447002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:13.447276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:13.449021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:13.461597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:13.463708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:13.476397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1272/2513] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:18.778282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:18.794068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697037c-766c-48e4-a137-916cb126ab69 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:18.799628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:18.800227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:18.800504 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:18.800776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:18.802566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:18.819799 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:18.821684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:18.832689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1242/2514] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:22.137057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:22.149225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd74ca-733d-40b3-ae2f-35fc6f6b5c3e service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:22.154824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3f936-8070-43d3-aab8-4270ef622669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:22.155468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f936-8070-43d3-aab8-4270ef622669 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:22.155748 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f936-8070-43d3-aab8-4270ef622669 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:22.156024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3f936-8070-43d3-aab8-4270ef622669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:22.158444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5ee3f936-8070-43d3-aab8-4270ef622669 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:22.170834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3f936-8070-43d3-aab8-4270ef622669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:22.172477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3f936-8070-43d3-aab8-4270ef622669 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:22.183113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1273/2515] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:28.827646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=40 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:32.178685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=72 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:41.149993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:41.151753 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:41.163915 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40809e-b0e3-4da1-8766-ce546e2bb0b6 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:41.167490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:41.168085 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:41.168363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:41.168629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:41.170338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:41.180068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:41.181520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:41.189687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1243/2516] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:43.569297 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa7ba-a2b6-44b6-96e5-7710d3e44d0b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:43.569844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa7ba-a2b6-44b6-96e5-7710d3e44d0b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:43.569844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa7ba-a2b6-44b6-96e5-7710d3e44d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:43.590285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-04bfa7ba-a2b6-44b6-96e5-7710d3e44d0b None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:43.591493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-04bfa7ba-a2b6-44b6-96e5-7710d3e44d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:43.646297 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1274/2517] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:05:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:43.691734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:43.693671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:43.766634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99e19b-9742-4772-b246-8599e2293637 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:43.772807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940ca0-21e7-4bbd-baef-22b7f24e38fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:43.773505 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940ca0-21e7-4bbd-baef-22b7f24e38fe service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:43.773798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940ca0-21e7-4bbd-baef-22b7f24e38fe service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:43.774078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940ca0-21e7-4bbd-baef-22b7f24e38fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:43.783369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940ca0-21e7-4bbd-baef-22b7f24e38fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:43.784953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940ca0-21e7-4bbd-baef-22b7f24e38fe service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:43.793580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1244/2518] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:05:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:05:45.534175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfa7ba-a2b6-44b6-96e5-7710d3e44d0b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:45.547896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfa7ba-a2b6-44b6-96e5-7710d3e44d0b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:45.554445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8d9a9-2ee3-457e-b5de-4601ac396b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:45.555300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8d9a9-2ee3-457e-b5de-4601ac396b4a service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:45.555752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8d9a9-2ee3-457e-b5de-4601ac396b4a service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:45.556176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8d9a9-2ee3-457e-b5de-4601ac396b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:45.558253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-30b8d9a9-2ee3-457e-b5de-4601ac396b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:45.637520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8d9a9-2ee3-457e-b5de-4601ac396b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:45.639115 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8d9a9-2ee3-457e-b5de-4601ac396b4a service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:45.650589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1275/2519] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:53.789956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=38 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:55.406941 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940ca0-21e7-4bbd-baef-22b7f24e38fe service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:55.416735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940ca0-21e7-4bbd-baef-22b7f24e38fe service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:55.420279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66495c1c-6a57-492a-9dd5-8718c4dedcec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:55.420864 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495c1c-6a57-492a-9dd5-8718c4dedcec service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:55.421175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495c1c-6a57-492a-9dd5-8718c4dedcec service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:55.421448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495c1c-6a57-492a-9dd5-8718c4dedcec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:55.423281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-66495c1c-6a57-492a-9dd5-8718c4dedcec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:55.435052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66495c1c-6a57-492a-9dd5-8718c4dedcec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:55.436438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66495c1c-6a57-492a-9dd5-8718c4dedcec service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:55.445831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1245/2520] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:55.645537 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=53 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:58.094126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b707b0-967f-4262-a162-d7a653a6ec1c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.095319 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b707b0-967f-4262-a162-d7a653a6ec1c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.095750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b707b0-967f-4262-a162-d7a653a6ec1c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.097836 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1276/2521] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:05:58.104399 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22a2dd-542f-4917-8d02-ac2741b256aa None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.105026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22a2dd-542f-4917-8d02-ac2741b256aa None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.105383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22a2dd-542f-4917-8d02-ac2741b256aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.129732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ce22a2dd-542f-4917-8d02-ac2741b256aa None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:58.131634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce22a2dd-542f-4917-8d02-ac2741b256aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:58.143676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1246/2522] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:05:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:58.155777 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b707b0-967f-4262-a162-d7a653a6ec1c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:58.157692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-52b707b0-967f-4262-a162-d7a653a6ec1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:58.248497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b707b0-967f-4262-a162-d7a653a6ec1c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:58.252170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edaf790-e29f-4205-8f81-972e3b8f4a34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:58.253183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf790-e29f-4205-8f81-972e3b8f4a34 service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.253520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf790-e29f-4205-8f81-972e3b8f4a34 service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.253797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edaf790-e29f-4205-8f81-972e3b8f4a34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.267268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaf790-e29f-4205-8f81-972e3b8f4a34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:58.268705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edaf790-e29f-4205-8f81-972e3b8f4a34 service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:58.285729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1277/2523] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:58.374012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae26d5-e0d1-4dd0-b9f3-0a74dbd8a51e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.374627 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae26d5-e0d1-4dd0-b9f3-0a74dbd8a51e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.375115 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae26d5-e0d1-4dd0-b9f3-0a74dbd8a51e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.376844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1247/2524] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:05:58.383568 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb5c98-a59e-4f39-b998-588149c1cba2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.384144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb5c98-a59e-4f39-b998-588149c1cba2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.384608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb5c98-a59e-4f39-b998-588149c1cba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.406004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-13fb5c98-a59e-4f39-b998-588149c1cba2 None None] MFA Rules not processed for user `3a1f548368994994a2966b7818e8b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:58.407235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-13fb5c98-a59e-4f39-b998-588149c1cba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:58.414492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1278/2525] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:05:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:58.426917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae26d5-e0d1-4dd0-b9f3-0a74dbd8a51e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:58.438610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae26d5-e0d1-4dd0-b9f3-0a74dbd8a51e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:58.442628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85464aaf-55c9-4e9b-937f-0f90cb4d2634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:58.443224 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464aaf-55c9-4e9b-937f-0f90cb4d2634 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.444219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464aaf-55c9-4e9b-937f-0f90cb4d2634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.444683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85464aaf-55c9-4e9b-937f-0f90cb4d2634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.452674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85464aaf-55c9-4e9b-937f-0f90cb4d2634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:58.454152 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85464aaf-55c9-4e9b-937f-0f90cb4d2634 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:58.462387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1248/2526] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:58.547078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318b4e-73dc-4206-864c-bd7caf2089ea None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.547450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318b4e-73dc-4206-864c-bd7caf2089ea None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.547801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10318b4e-73dc-4206-864c-bd7caf2089ea None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.549255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1279/2527] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 10 12:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 10 12:05:58.555038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab6eb-8622-4f44-824c-3f4c05c92721 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.555388 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab6eb-8622-4f44-824c-3f4c05c92721 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.555667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caab6eb-8622-4f44-824c-3f4c05c92721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.576533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7caab6eb-8622-4f44-824c-3f4c05c92721 None None] MFA Rules not processed for user `aa51dcbe21f04f24887beb458edb1dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:58.577790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7caab6eb-8622-4f44-824c-3f4c05c92721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:58.587272 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1249/2528] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 10 12:05:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:58.598031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318b4e-73dc-4206-864c-bd7caf2089ea None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:58.610099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10318b4e-73dc-4206-864c-bd7caf2089ea None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:58.613654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:58.614273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:58.614552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:58.614823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:58.626552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:58.628001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:58.639833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1280/2529] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:59.140701 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caab6eb-8622-4f44-824c-3f4c05c92721 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:59.142158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7caab6eb-8622-4f44-824c-3f4c05c92721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:59.158156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caab6eb-8622-4f44-824c-3f4c05c92721 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:59.168556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:59.169515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:59.170064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:59.170431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:59.172654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:59.189525 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:59.191539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:59.207983 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1250/2530] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:05:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:05:59.209796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:59.211214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:59.229306 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba1613-80fd-4b28-9368-fdfe3f3fa319 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:59.234779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:59.235835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:59.236735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:59.237063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] PATH_INFO: `/v3/users/912b5f1275fb43dfb1c0a9c47ecb3fc9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:59.238201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=912b5f1275fb43dfb1c0a9c47ecb3fc9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:59.240116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:59.303665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912b5f1275fb43dfb1c0a9c47ecb3fc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.316219 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912b5f1275fb43dfb1c0a9c47ecb3fc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.316950 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912b5f1275fb43dfb1c0a9c47ecb3fc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.325694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912b5f1275fb43dfb1c0a9c47ecb3fc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.326952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3a2f54b2-6eca-4802-ab66-bb44f7a0b72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912b5f1275fb43dfb1c0a9c47ecb3fc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.340369 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1281/2531] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:05:59 2022] DELETE /identity/v3/users/912b5f1275fb43dfb1c0a9c47ecb3fc9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:05:59.529180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:59.543105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450da691-9c87-412b-bf0b-6b7d1ea04026 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:59.605014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:59.605834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:59.606117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:59.606395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] PATH_INFO: `/v3/projects/1934b77d066f47288897e48dacefc20d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:59.607510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1934b77d066f47288897e48dacefc20d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:59.609471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:59.655461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1934b77d066f47288897e48dacefc20d', 'request_id': 'req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.660850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1934b77d066f47288897e48dacefc20d', 'request_id': 'req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.667417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1934b77d066f47288897e48dacefc20d', 'request_id': 'req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.679156 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] The token cache is being invalidate because project 1934b77d066f47288897e48dacefc20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:05:59.679442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.680081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5b35b0b3-9c44-4b04-8ffd-8e49328892f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:05:59.681589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1251/2532] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:05:59 2022] DELETE /identity/v3/projects/1934b77d066f47288897e48dacefc20d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:05:59.686398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdf0e6-d718-4a54-8dcb-3a5a5e899d0a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:59.686692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdf0e6-d718-4a54-8dcb-3a5a5e899d0a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:59.686974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdf0e6-d718-4a54-8dcb-3a5a5e899d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:59.706533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-87cdf0e6-d718-4a54-8dcb-3a5a5e899d0a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:59.707649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-87cdf0e6-d718-4a54-8dcb-3a5a5e899d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:59.755384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:05:59.768104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1282/2533] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:59.776360 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf28a1f-97d4-4694-aa75-cfee1d391fc2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:59.776653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf28a1f-97d4-4694-aa75-cfee1d391fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:59.776933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf28a1f-97d4-4694-aa75-cfee1d391fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:59.796773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-acf28a1f-97d4-4694-aa75-cfee1d391fc2 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:05:59.798011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-acf28a1f-97d4-4694-aa75-cfee1d391fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:05:59.806018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1252/2534] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:05:59.810138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdf0e6-d718-4a54-8dcb-3a5a5e899d0a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:59.819857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdf0e6-d718-4a54-8dcb-3a5a5e899d0a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:59.828345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:59.829214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:59.829498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:59.829888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:59.830545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:05:59.830852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:59.832459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:59.845700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1283/2535] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:05:59.850707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf28a1f-97d4-4694-aa75-cfee1d391fc2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:59.860074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf28a1f-97d4-4694-aa75-cfee1d391fc2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:59.864896 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c323c-db11-4f6a-b681-912f56ed4ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:59.865556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c323c-db11-4f6a-b681-912f56ed4ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:59.865841 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c323c-db11-4f6a-b681-912f56ed4ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:59.866112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c323c-db11-4f6a-b681-912f56ed4ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:59.866741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c323c-db11-4f6a-b681-912f56ed4ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:59.868634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c323c-db11-4f6a-b681-912f56ed4ed0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:59.897909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1253/2536] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:05:59 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:05:59.901972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:05:59.913556 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4de4b8-4e98-4075-9e6d-761e4a9fe101 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:05:59.970056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460717a-961f-429b-bdb9-5eeacf0248f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:05:59.970610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460717a-961f-429b-bdb9-5eeacf0248f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:05:59.970895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460717a-961f-429b-bdb9-5eeacf0248f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:05:59.971287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460717a-961f-429b-bdb9-5eeacf0248f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:05:59.971986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460717a-961f-429b-bdb9-5eeacf0248f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:05:59.973965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460717a-961f-429b-bdb9-5eeacf0248f1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:05:59.999589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1284/2537] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:05:59 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:00.000794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c323c-db11-4f6a-b681-912f56ed4ed0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:00.011506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c323c-db11-4f6a-b681-912f56ed4ed0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:00.016666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ea739-202a-4d0f-b336-313b4ab16fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:00.017465 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ea739-202a-4d0f-b336-313b4ab16fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:00.017659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ea739-202a-4d0f-b336-313b4ab16fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:00.017996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ea739-202a-4d0f-b336-313b4ab16fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:00.018641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ea739-202a-4d0f-b336-313b4ab16fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:00.020422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ea739-202a-4d0f-b336-313b4ab16fb2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:00.023517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:00.033191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1254/2538] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:06:00.037149 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460717a-961f-429b-bdb9-5eeacf0248f1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:00.047201 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460717a-961f-429b-bdb9-5eeacf0248f1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:00.051945 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae129e3-9be1-46a3-ac3b-4bb3ee619cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:00.052638 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae129e3-9be1-46a3-ac3b-4bb3ee619cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:00.052994 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae129e3-9be1-46a3-ac3b-4bb3ee619cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:00.053312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae129e3-9be1-46a3-ac3b-4bb3ee619cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:00.053955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae129e3-9be1-46a3-ac3b-4bb3ee619cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:00.055596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae129e3-9be1-46a3-ac3b-4bb3ee619cb4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:00.067211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1285/2539] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:06:00.071897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ea739-202a-4d0f-b336-313b4ab16fb2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:00.082343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ea739-202a-4d0f-b336-313b4ab16fb2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:00.087566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:00.088209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:00.088488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:00.088762 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] PATH_INFO: `/v3/projects/5d270f883d1348c0ae6a16dcf2432548/users/c3782b2bcb824261a5f4c209a35a2e21/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:00.103255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d270f883d1348c0ae6a16dcf2432548, user_id=c3782b2bcb824261a5f4c209a35a2e21, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:00.105943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:00.120479 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1255/2540] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:00 2022] PUT /identity/v3/projects/5d270f883d1348c0ae6a16dcf2432548/users/c3782b2bcb824261a5f4c209a35a2e21/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:00.125528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7c6a-1cbd-469c-891b-985bd0505020 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:00.125817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7c6a-1cbd-469c-891b-985bd0505020 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:00.126103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7c6a-1cbd-469c-891b-985bd0505020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:00.145474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9a3d7c6a-1cbd-469c-891b-985bd0505020 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:00.147239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a3d7c6a-1cbd-469c-891b-985bd0505020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:00.205977 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1286/2541] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:00.216269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:00.218245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:00.277331 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8174-c803-4f5f-80be-539d568b3608 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:00.281994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:00.282685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:00.283032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:00.283994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:00.295038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:00.296472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:00.306141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1256/2542] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:00.747967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba397c36-f509-4cc3-8725-8322a7e21f57 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:00.748553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba397c36-f509-4cc3-8725-8322a7e21f57 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:00.749895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba397c36-f509-4cc3-8725-8322a7e21f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:00.770365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ba397c36-f509-4cc3-8725-8322a7e21f57 None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:00.771900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ba397c36-f509-4cc3-8725-8322a7e21f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:00.831685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1287/2543] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:00.845380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:00.846879 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:00.920832 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510ca97-4f39-469a-b792-6405db2e4fa3 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:00.926813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c39a1-cd21-4d36-8eea-b9dfc44b2b90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:00.927544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c39a1-cd21-4d36-8eea-b9dfc44b2b90 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:00.928457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c39a1-cd21-4d36-8eea-b9dfc44b2b90 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:00.928887 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c39a1-cd21-4d36-8eea-b9dfc44b2b90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:00.938509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c39a1-cd21-4d36-8eea-b9dfc44b2b90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:00.940240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c39a1-cd21-4d36-8eea-b9dfc44b2b90 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:00.951014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1257/2544] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:06:01.124745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7558-1bed-49b3-80fb-a02d3f08af09 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:01.125355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7558-1bed-49b3-80fb-a02d3f08af09 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:01.125924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7558-1bed-49b3-80fb-a02d3f08af09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:01.155370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:01.177625 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-74fa7558-1bed-49b3-80fb-a02d3f08af09 None None] MFA Rules not processed for user `c3782b2bcb824261a5f4c209a35a2e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:01.180099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-74fa7558-1bed-49b3-80fb-a02d3f08af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:01.322542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1288/2545] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:01 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:01.327806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c39a1-cd21-4d36-8eea-b9dfc44b2b90 service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:01.346781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c39a1-cd21-4d36-8eea-b9dfc44b2b90 service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:01.357379 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f921a2-3f54-4494-8b61-a405946c920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:01.358485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f921a2-3f54-4494-8b61-a405946c920f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:01.359038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f921a2-3f54-4494-8b61-a405946c920f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:01.359724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f921a2-3f54-4494-8b61-a405946c920f admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:01.360833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f921a2-3f54-4494-8b61-a405946c920f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:01.363695 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f921a2-3f54-4494-8b61-a405946c920f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:01.398400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1258/2546] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:01 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:01.402881 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa7558-1bed-49b3-80fb-a02d3f08af09 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:01.419646 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa7558-1bed-49b3-80fb-a02d3f08af09 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:01.493985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c23d9-9fde-4f8f-92f4-d6c549db35d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:01.494954 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c23d9-9fde-4f8f-92f4-d6c549db35d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:01.495336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c23d9-9fde-4f8f-92f4-d6c549db35d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:01.495612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c23d9-9fde-4f8f-92f4-d6c549db35d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:01.501168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c23d9-9fde-4f8f-92f4-d6c549db35d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:01.507364 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c23d9-9fde-4f8f-92f4-d6c549db35d8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:01.539135 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1289/2547] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:01 2022] POST /identity/v3/users => generated 308 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:06:01.543141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f921a2-3f54-4494-8b61-a405946c920f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:01.560032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f921a2-3f54-4494-8b61-a405946c920f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:01.566714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03e19-17ec-439b-9263-33a4f2900c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:01.567348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03e19-17ec-439b-9263-33a4f2900c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:01.567569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03e19-17ec-439b-9263-33a4f2900c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:01.567849 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd03e19-17ec-439b-9263-33a4f2900c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:01.569122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd03e19-17ec-439b-9263-33a4f2900c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:01.570947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd03e19-17ec-439b-9263-33a4f2900c21 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:01.585343 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1259/2548] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:01.589927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c23d9-9fde-4f8f-92f4-d6c549db35d8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:01.600510 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c23d9-9fde-4f8f-92f4-d6c549db35d8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:01.605548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832018ca-9c2a-4d13-8d24-7d95badd9b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:01.606291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832018ca-9c2a-4d13-8d24-7d95badd9b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:01.606686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832018ca-9c2a-4d13-8d24-7d95badd9b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:01.607064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832018ca-9c2a-4d13-8d24-7d95badd9b10 admin admin] PATH_INFO: `/v3/projects/5abee83efa8f480da5c95d8c7dca1348/users/07e4ab097fde4478914119834cfba55a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:01.626220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832018ca-9c2a-4d13-8d24-7d95badd9b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abee83efa8f480da5c95d8c7dca1348, user_id=07e4ab097fde4478914119834cfba55a, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:01.629083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832018ca-9c2a-4d13-8d24-7d95badd9b10 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:01.647497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1290/2549] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:01 2022] PUT /identity/v3/projects/5abee83efa8f480da5c95d8c7dca1348/users/07e4ab097fde4478914119834cfba55a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:01.651809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03e19-17ec-439b-9263-33a4f2900c21 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:01.664456 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd03e19-17ec-439b-9263-33a4f2900c21 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:01.704683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:01.738266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb120-e1d8-4970-b13a-84ed1b020211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:01.738875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb120-e1d8-4970-b13a-84ed1b020211 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:01.739157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb120-e1d8-4970-b13a-84ed1b020211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:01.739427 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb120-e1d8-4970-b13a-84ed1b020211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:01.740063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb120-e1d8-4970-b13a-84ed1b020211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:01.741724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb120-e1d8-4970-b13a-84ed1b020211 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:01.751649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1260/2550] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:01.755659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832018ca-9c2a-4d13-8d24-7d95badd9b10 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:01.768224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832018ca-9c2a-4d13-8d24-7d95badd9b10 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:01.773780 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218c47-3b68-4cf3-8768-3baabe002d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:01.774468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218c47-3b68-4cf3-8768-3baabe002d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:01.774742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218c47-3b68-4cf3-8768-3baabe002d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:01.775012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da218c47-3b68-4cf3-8768-3baabe002d2f admin admin] PATH_INFO: `/v3/projects/5abee83efa8f480da5c95d8c7dca1348/users/07e4ab097fde4478914119834cfba55a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:01.778362 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da218c47-3b68-4cf3-8768-3baabe002d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abee83efa8f480da5c95d8c7dca1348, user_id=07e4ab097fde4478914119834cfba55a, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:01.781106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da218c47-3b68-4cf3-8768-3baabe002d2f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:01.792075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1291/2551] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:01 2022] PUT /identity/v3/projects/5abee83efa8f480da5c95d8c7dca1348/users/07e4ab097fde4478914119834cfba55a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:02.577143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121d93-407e-47f6-875e-5090f4ee70b8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:02.578135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121d93-407e-47f6-875e-5090f4ee70b8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:02.578623 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37121d93-407e-47f6-875e-5090f4ee70b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:02.613437 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-37121d93-407e-47f6-875e-5090f4ee70b8 None None] MFA Rules not processed for user `07e4ab097fde4478914119834cfba55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:02.614551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-37121d93-407e-47f6-875e-5090f4ee70b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:02.684859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1261/2552] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:03.850802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218c47-3b68-4cf3-8768-3baabe002d2f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:03.914004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:03.928804 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da218c47-3b68-4cf3-8768-3baabe002d2f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:03.933632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:03.935566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:03.935924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:03.936270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] PATH_INFO: `/v3/users/c3782b2bcb824261a5f4c209a35a2e21` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:03.937789 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3782b2bcb824261a5f4c209a35a2e21)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:03.939719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:03.988633 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3782b2bcb824261a5f4c209a35a2e21'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.000242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3782b2bcb824261a5f4c209a35a2e21'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.000916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3782b2bcb824261a5f4c209a35a2e21'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.008500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3782b2bcb824261a5f4c209a35a2e21'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.009286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3782b2bcb824261a5f4c209a35a2e21'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.021361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1292/2553] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:03 2022] DELETE /identity/v3/users/c3782b2bcb824261a5f4c209a35a2e21 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:04.195782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37121d93-407e-47f6-875e-5090f4ee70b8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:04.206812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37121d93-407e-47f6-875e-5090f4ee70b8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:04.282868 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:04.283516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:04.283807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:04.284110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] PATH_INFO: `/v3/projects/5d270f883d1348c0ae6a16dcf2432548` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:04.285736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d270f883d1348c0ae6a16dcf2432548)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:04.287333 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:04.349961 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d270f883d1348c0ae6a16dcf2432548', 'request_id': 'req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.355074 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:04.356316 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d270f883d1348c0ae6a16dcf2432548', 'request_id': 'req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.364046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d270f883d1348c0ae6a16dcf2432548', 'request_id': 'req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.379486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] The token cache is being invalidate because project 5d270f883d1348c0ae6a16dcf2432548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:04.379946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.380913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.385011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1262/2554] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:04 2022] DELETE /identity/v3/projects/5d270f883d1348c0ae6a16dcf2432548 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:04.387974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:04.389468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:04.403747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf80294-98b8-4d0f-851a-15d69a8a600e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:04.518065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:04.518719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:04.519000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:04.519276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] PATH_INFO: `/v3/users/07e4ab097fde4478914119834cfba55a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:04.521714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e4ab097fde4478914119834cfba55a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:04.524467 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:04.572608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e4ab097fde4478914119834cfba55a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.585061 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e4ab097fde4478914119834cfba55a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.585721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e4ab097fde4478914119834cfba55a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.589391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:04.593187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e4ab097fde4478914119834cfba55a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.593864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-af7d1242-180f-4e0a-9b80-9f28b2099cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e4ab097fde4478914119834cfba55a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.608075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1293/2555] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:04 2022] DELETE /identity/v3/users/07e4ab097fde4478914119834cfba55a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:06:04.791418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:04.792922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:04.820532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa6541-0cb4-491a-a6c7-1e6ed9405473 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:04.898483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:04.899418 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:04.899886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:04.900338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] PATH_INFO: `/v3/projects/5abee83efa8f480da5c95d8c7dca1348` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:04.901850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abee83efa8f480da5c95d8c7dca1348)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:04.904637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:04.959951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abee83efa8f480da5c95d8c7dca1348', 'request_id': 'req-b24516df-bb73-4e79-8d4d-c9faad40a68f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.965345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abee83efa8f480da5c95d8c7dca1348', 'request_id': 'req-b24516df-bb73-4e79-8d4d-c9faad40a68f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.972103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abee83efa8f480da5c95d8c7dca1348', 'request_id': 'req-b24516df-bb73-4e79-8d4d-c9faad40a68f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.994332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] The token cache is being invalidate because project 5abee83efa8f480da5c95d8c7dca1348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:04.994747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:04.995526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b24516df-bb73-4e79-8d4d-c9faad40a68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:05.007282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1263/2556] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:04 2022] DELETE /identity/v3/projects/5abee83efa8f480da5c95d8c7dca1348 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:05.009051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c41a1-b813-4406-99d3-67bf1af2298d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.009860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c41a1-b813-4406-99d3-67bf1af2298d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.010138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c41a1-b813-4406-99d3-67bf1af2298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.033233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6b7c41a1-b813-4406-99d3-67bf1af2298d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:05.034897 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6b7c41a1-b813-4406-99d3-67bf1af2298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:05.104597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1294/2557] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:05.112297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe082c9-c2bf-422f-8a44-e6477db89eab None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.112768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe082c9-c2bf-422f-8a44-e6477db89eab None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.112954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe082c9-c2bf-422f-8a44-e6477db89eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.136534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-efe082c9-c2bf-422f-8a44-e6477db89eab None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:05.137821 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-efe082c9-c2bf-422f-8a44-e6477db89eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:05.150245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1264/2558] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:05.151255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c41a1-b813-4406-99d3-67bf1af2298d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.163051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c41a1-b813-4406-99d3-67bf1af2298d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.170001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.170642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.170942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.171232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.171880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:06:05.172176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.173833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.190204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1295/2559] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:06:05.191346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe082c9-c2bf-422f-8a44-e6477db89eab None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.201933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe082c9-c2bf-422f-8a44-e6477db89eab None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.206869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa771-5a75-4ef6-ae75-ab9cb919f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.207582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa771-5a75-4ef6-ae75-ab9cb919f910 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.207937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa771-5a75-4ef6-ae75-ab9cb919f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.208289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfa771-5a75-4ef6-ae75-ab9cb919f910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.209034 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfa771-5a75-4ef6-ae75-ab9cb919f910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.211063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfa771-5a75-4ef6-ae75-ab9cb919f910 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.242806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1265/2560] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:05 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:06:05.247052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.257251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2a37-3ed5-40da-8148-c65501b417da admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.328198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1536-84d6-494a-88db-b6bfec84719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.328853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1536-84d6-494a-88db-b6bfec84719c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.329128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1536-84d6-494a-88db-b6bfec84719c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.329412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1536-84d6-494a-88db-b6bfec84719c admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.330121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce1536-84d6-494a-88db-b6bfec84719c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.332064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce1536-84d6-494a-88db-b6bfec84719c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.362730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1296/2561] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:05 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:05.366851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa771-5a75-4ef6-ae75-ab9cb919f910 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.377757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfa771-5a75-4ef6-ae75-ab9cb919f910 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.382934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51a7fe-b080-45b5-a833-fd60a8949dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.383539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a7fe-b080-45b5-a833-fd60a8949dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.383816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a7fe-b080-45b5-a833-fd60a8949dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.384087 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a7fe-b080-45b5-a833-fd60a8949dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.384878 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51a7fe-b080-45b5-a833-fd60a8949dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.386543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51a7fe-b080-45b5-a833-fd60a8949dc3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.398368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1266/2562] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:05.402436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1536-84d6-494a-88db-b6bfec84719c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.413247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce1536-84d6-494a-88db-b6bfec84719c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.417900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5234ce8-ad40-4198-a29f-3de8e8610fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.418511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5234ce8-ad40-4198-a29f-3de8e8610fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.418787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5234ce8-ad40-4198-a29f-3de8e8610fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.419083 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5234ce8-ad40-4198-a29f-3de8e8610fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.419728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5234ce8-ad40-4198-a29f-3de8e8610fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.421530 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5234ce8-ad40-4198-a29f-3de8e8610fa8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.433282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1297/2563] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:06:05.437358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51a7fe-b080-45b5-a833-fd60a8949dc3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.447802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51a7fe-b080-45b5-a833-fd60a8949dc3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.452816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f54ef-acbf-408f-995b-744e8e5081f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.453509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f54ef-acbf-408f-995b-744e8e5081f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.453794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f54ef-acbf-408f-995b-744e8e5081f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.454069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f54ef-acbf-408f-995b-744e8e5081f8 admin admin] PATH_INFO: `/v3/projects/4672d217d3e944799e7ac5bb149970f3/users/62c561fc90f8472d934141f11d2011aa/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.474453 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f54ef-acbf-408f-995b-744e8e5081f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4672d217d3e944799e7ac5bb149970f3, user_id=62c561fc90f8472d934141f11d2011aa, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.477988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f54ef-acbf-408f-995b-744e8e5081f8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.495211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1267/2564] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:05 2022] PUT /identity/v3/projects/4672d217d3e944799e7ac5bb149970f3/users/62c561fc90f8472d934141f11d2011aa/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:05.505622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671e19f-ce09-4dd7-abc1-5f29b43980f0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.505909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671e19f-ce09-4dd7-abc1-5f29b43980f0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.506225 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671e19f-ce09-4dd7-abc1-5f29b43980f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.557842 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c671e19f-ce09-4dd7-abc1-5f29b43980f0 None None] MFA Rules not processed for user `62c561fc90f8472d934141f11d2011aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:05.560708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c671e19f-ce09-4dd7-abc1-5f29b43980f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:05.608008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:05.633982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1298/2565] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:05.638375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f54ef-acbf-408f-995b-744e8e5081f8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.662180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:05.757200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f54ef-acbf-408f-995b-744e8e5081f8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.761947 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c335-9e40-469f-8618-327d6155e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.762553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c335-9e40-469f-8618-327d6155e724 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.762831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c335-9e40-469f-8618-327d6155e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.763100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c335-9e40-469f-8618-327d6155e724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.763727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541c335-9e40-469f-8618-327d6155e724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.765732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541c335-9e40-469f-8618-327d6155e724 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.792842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1268/2566] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:05 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:05.797107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671e19f-ce09-4dd7-abc1-5f29b43980f0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.809295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671e19f-ce09-4dd7-abc1-5f29b43980f0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.865287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17e706-1242-417b-bc6c-a1c40ad2686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.866431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e706-1242-417b-bc6c-a1c40ad2686d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.866709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e706-1242-417b-bc6c-a1c40ad2686d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.866980 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17e706-1242-417b-bc6c-a1c40ad2686d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.867637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17e706-1242-417b-bc6c-a1c40ad2686d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.869563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17e706-1242-417b-bc6c-a1c40ad2686d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.892735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1299/2567] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:05 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:05.897445 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c335-9e40-469f-8618-327d6155e724 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.916272 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c335-9e40-469f-8618-327d6155e724 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.921588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42593d7-9587-45c0-b33e-f4e33f024cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.922207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42593d7-9587-45c0-b33e-f4e33f024cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.922485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42593d7-9587-45c0-b33e-f4e33f024cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.922912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42593d7-9587-45c0-b33e-f4e33f024cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.923593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42593d7-9587-45c0-b33e-f4e33f024cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.925381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42593d7-9587-45c0-b33e-f4e33f024cd0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:05.942924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1269/2568] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:05.945475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17e706-1242-417b-bc6c-a1c40ad2686d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:05.962116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17e706-1242-417b-bc6c-a1c40ad2686d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:05.967317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d7e33-c23a-4e6a-a6d4-49b1c772f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:05.967983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7e33-c23a-4e6a-a6d4-49b1c772f060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:05.968263 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7e33-c23a-4e6a-a6d4-49b1c772f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:05.968537 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7e33-c23a-4e6a-a6d4-49b1c772f060 admin admin] PATH_INFO: `/v3/projects/fe8010ffb93d455fb32ae0788bbe2b36/users/b68ef9b1472c4933927cac81b92e7680/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:05.987321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d7e33-c23a-4e6a-a6d4-49b1c772f060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8010ffb93d455fb32ae0788bbe2b36, user_id=b68ef9b1472c4933927cac81b92e7680, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:05.990066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d7e33-c23a-4e6a-a6d4-49b1c772f060 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:06.005406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1300/2569] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:05 2022] PUT /identity/v3/projects/fe8010ffb93d455fb32ae0788bbe2b36/users/b68ef9b1472c4933927cac81b92e7680/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:06.009454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42593d7-9587-45c0-b33e-f4e33f024cd0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:06.019431 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42593d7-9587-45c0-b33e-f4e33f024cd0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:06.095257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25220166-e11f-4544-a3d8-37cb28d009f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:06.095975 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25220166-e11f-4544-a3d8-37cb28d009f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:06.096470 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25220166-e11f-4544-a3d8-37cb28d009f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:06.096802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25220166-e11f-4544-a3d8-37cb28d009f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:06.097540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25220166-e11f-4544-a3d8-37cb28d009f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:06.099337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25220166-e11f-4544-a3d8-37cb28d009f1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:06.111150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1270/2570] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:06:06.115475 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d7e33-c23a-4e6a-a6d4-49b1c772f060 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:06.127287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d7e33-c23a-4e6a-a6d4-49b1c772f060 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:06.132001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:06.132660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:06.132940 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:06.133252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] PATH_INFO: `/v3/projects/fe8010ffb93d455fb32ae0788bbe2b36/users/b68ef9b1472c4933927cac81b92e7680/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:06.135208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8010ffb93d455fb32ae0788bbe2b36, user_id=b68ef9b1472c4933927cac81b92e7680, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:06.138022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:06.149060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1301/2571] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:06 2022] PUT /identity/v3/projects/fe8010ffb93d455fb32ae0788bbe2b36/users/b68ef9b1472c4933927cac81b92e7680/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:06.160302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f97e-09c1-4e09-8826-cd8650f28095 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:06.160595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f97e-09c1-4e09-8826-cd8650f28095 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:06.160873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9f97e-09c1-4e09-8826-cd8650f28095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:06.191145 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-70e9f97e-09c1-4e09-8826-cd8650f28095 None None] MFA Rules not processed for user `b68ef9b1472c4933927cac81b92e7680`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:06.192357 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70e9f97e-09c1-4e09-8826-cd8650f28095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:06.268393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1271/2572] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:06.280591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:06.282513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:06.344721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384500e-9b35-403b-8417-c1548cdc4d32 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:06.348489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac650d7e-a9ad-4a1d-bbcb-95500d7c5a2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:06.349211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac650d7e-a9ad-4a1d-bbcb-95500d7c5a2d service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:06.349550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac650d7e-a9ad-4a1d-bbcb-95500d7c5a2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:06.349898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac650d7e-a9ad-4a1d-bbcb-95500d7c5a2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:06.359738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac650d7e-a9ad-4a1d-bbcb-95500d7c5a2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:06.361497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac650d7e-a9ad-4a1d-bbcb-95500d7c5a2d service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:06.372001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1302/2573] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:06.427988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f97e-09c1-4e09-8826-cd8650f28095 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:06.429460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70e9f97e-09c1-4e09-8826-cd8650f28095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:06.442474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9f97e-09c1-4e09-8826-cd8650f28095 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:06.446222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190db04-c7ca-4b76-a897-8b9f825ef0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:06.446833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190db04-c7ca-4b76-a897-8b9f825ef0ab service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:06.447112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190db04-c7ca-4b76-a897-8b9f825ef0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:06.447382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190db04-c7ca-4b76-a897-8b9f825ef0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:06.452444 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:06.539827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190db04-c7ca-4b76-a897-8b9f825ef0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:06.541337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190db04-c7ca-4b76-a897-8b9f825ef0ab service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:06.550513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1272/2574] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:10.139288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac650d7e-a9ad-4a1d-bbcb-95500d7c5a2d service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:10.183740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:10.206859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac650d7e-a9ad-4a1d-bbcb-95500d7c5a2d service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:10.212632 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:10.213397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:10.213747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:10.214093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] PATH_INFO: `/v3/users/62c561fc90f8472d934141f11d2011aa` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:10.215323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c561fc90f8472d934141f11d2011aa)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:10.217304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:10.262797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c561fc90f8472d934141f11d2011aa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.275144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c561fc90f8472d934141f11d2011aa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.275812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c561fc90f8472d934141f11d2011aa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.283486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c561fc90f8472d934141f11d2011aa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.284141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c561fc90f8472d934141f11d2011aa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.297434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1303/2575] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:10 2022] DELETE /identity/v3/users/62c561fc90f8472d934141f11d2011aa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:10.302450 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce495a28-4e74-4fe5-863f-0151a2b447a8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:10.302986 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce495a28-4e74-4fe5-863f-0151a2b447a8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:10.303198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce495a28-4e74-4fe5-863f-0151a2b447a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:10.326256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ce495a28-4e74-4fe5-863f-0151a2b447a8 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:10.327581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce495a28-4e74-4fe5-863f-0151a2b447a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:10.391028 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1273/2576] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:10.401264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:10.402683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:10.459226 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060176-614a-4baa-9f72-00a1170033a9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:10.463614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbdbda-00d5-4831-a64a-976629920f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:10.464255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbdbda-00d5-4831-a64a-976629920f27 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:10.464539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbdbda-00d5-4831-a64a-976629920f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:10.464815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbdbda-00d5-4831-a64a-976629920f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:10.473802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbdbda-00d5-4831-a64a-976629920f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:10.475269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbdbda-00d5-4831-a64a-976629920f27 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:10.486352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1304/2577] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:10.777550 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce495a28-4e74-4fe5-863f-0151a2b447a8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:10.779009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce495a28-4e74-4fe5-863f-0151a2b447a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:10.791093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce495a28-4e74-4fe5-863f-0151a2b447a8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:10.795996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:10.796628 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:10.796905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:10.797209 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] PATH_INFO: `/v3/projects/4672d217d3e944799e7ac5bb149970f3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:10.798319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4672d217d3e944799e7ac5bb149970f3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:10.800279 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:10.851495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4672d217d3e944799e7ac5bb149970f3', 'request_id': 'req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.857019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4672d217d3e944799e7ac5bb149970f3', 'request_id': 'req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.863179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4672d217d3e944799e7ac5bb149970f3', 'request_id': 'req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.875212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] The token cache is being invalidate because project 4672d217d3e944799e7ac5bb149970f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:10.875496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.876100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:10.877638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1274/2578] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:10 2022] DELETE /identity/v3/projects/4672d217d3e944799e7ac5bb149970f3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:10.882426 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbdbda-00d5-4831-a64a-976629920f27 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:10.891828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbdbda-00d5-4831-a64a-976629920f27 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:10.952528 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:10.953198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:10.953478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:10.953749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] PATH_INFO: `/v3/users/b68ef9b1472c4933927cac81b92e7680` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:10.954852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68ef9b1472c4933927cac81b92e7680)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:10.956800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:10.958262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:11.003670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68ef9b1472c4933927cac81b92e7680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.016859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68ef9b1472c4933927cac81b92e7680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.017598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68ef9b1472c4933927cac81b92e7680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.024533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68ef9b1472c4933927cac81b92e7680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.025169 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5130345f-587c-4caa-91a0-cbd54a726284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68ef9b1472c4933927cac81b92e7680'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.037495 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1305/2579] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:10 2022] DELETE /identity/v3/users/b68ef9b1472c4933927cac81b92e7680 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:11.305079 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:11.306510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:11.319779 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fd4e4-756e-4d72-aa78-bdd34ffe8bfa admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:11.347082 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:11.380736 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:11.381403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.381708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.381987 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] PATH_INFO: `/v3/projects/fe8010ffb93d455fb32ae0788bbe2b36` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.383135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8010ffb93d455fb32ae0788bbe2b36)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:11.385137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:11.430980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8010ffb93d455fb32ae0788bbe2b36', 'request_id': 'req-42375dc2-0402-452d-9d6e-f1abc01b0671'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.436404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8010ffb93d455fb32ae0788bbe2b36', 'request_id': 'req-42375dc2-0402-452d-9d6e-f1abc01b0671'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.442513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8010ffb93d455fb32ae0788bbe2b36', 'request_id': 'req-42375dc2-0402-452d-9d6e-f1abc01b0671'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.454950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] The token cache is being invalidate because project fe8010ffb93d455fb32ae0788bbe2b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:11.455235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.455858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-42375dc2-0402-452d-9d6e-f1abc01b0671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:11.457359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1275/2580] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:11 2022] DELETE /identity/v3/projects/fe8010ffb93d455fb32ae0788bbe2b36 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:06:11.462262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31139b-aaf7-4b51-a6d7-ec47bf78de27 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.462790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31139b-aaf7-4b51-a6d7-ec47bf78de27 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.462898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31139b-aaf7-4b51-a6d7-ec47bf78de27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.482425 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-be31139b-aaf7-4b51-a6d7-ec47bf78de27 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:11.483609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-be31139b-aaf7-4b51-a6d7-ec47bf78de27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:11.540614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1306/2581] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:11.548337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c63f-7d70-464e-906e-364cb0a90595 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.548630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c63f-7d70-464e-906e-364cb0a90595 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.548909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c63f-7d70-464e-906e-364cb0a90595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.568892 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f4c1c63f-7d70-464e-906e-364cb0a90595 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:11.571301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f4c1c63f-7d70-464e-906e-364cb0a90595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:11.580198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1276/2582] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:11.584360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31139b-aaf7-4b51-a6d7-ec47bf78de27 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:11.594698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31139b-aaf7-4b51-a6d7-ec47bf78de27 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:11.599251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:11.599848 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.600127 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.600401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.601111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:06:11.601417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:11.603006 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:11.614880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1307/2583] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:06:11.620099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c63f-7d70-464e-906e-364cb0a90595 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:11.629636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c63f-7d70-464e-906e-364cb0a90595 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:11.634927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7ff1b-228e-4ba5-936b-5fbd6ead3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:11.635574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7ff1b-228e-4ba5-936b-5fbd6ead3f36 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.635805 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7ff1b-228e-4ba5-936b-5fbd6ead3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.636077 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7ff1b-228e-4ba5-936b-5fbd6ead3f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.636715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7ff1b-228e-4ba5-936b-5fbd6ead3f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:11.638653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7ff1b-228e-4ba5-936b-5fbd6ead3f36 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:11.665717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1277/2584] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:11 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:11.669691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:11.680606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a6456-3a0f-41e3-a69b-046bc190b046 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:11.748177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66310766-fe67-4ca0-a841-a407690c0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:11.748868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66310766-fe67-4ca0-a841-a407690c0b69 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.749266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66310766-fe67-4ca0-a841-a407690c0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.749610 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66310766-fe67-4ca0-a841-a407690c0b69 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.750315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66310766-fe67-4ca0-a841-a407690c0b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:11.752455 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66310766-fe67-4ca0-a841-a407690c0b69 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:11.765778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:11.779137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1308/2585] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:11 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:11.783956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7ff1b-228e-4ba5-936b-5fbd6ead3f36 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:11.795723 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7ff1b-228e-4ba5-936b-5fbd6ead3f36 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:11.801434 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af382-efb7-488a-8c43-9522cb5a2135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:11.801984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af382-efb7-488a-8c43-9522cb5a2135 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.802368 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af382-efb7-488a-8c43-9522cb5a2135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.802755 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651af382-efb7-488a-8c43-9522cb5a2135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.808442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af382-efb7-488a-8c43-9522cb5a2135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:11.808442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651af382-efb7-488a-8c43-9522cb5a2135 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:11.820791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1278/2586] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:11.821579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66310766-fe67-4ca0-a841-a407690c0b69 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:11.833909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66310766-fe67-4ca0-a841-a407690c0b69 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:11.840303 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836674e-ce35-44e8-aedf-24db6a67f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:11.841262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836674e-ce35-44e8-aedf-24db6a67f5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.841493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836674e-ce35-44e8-aedf-24db6a67f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.841864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836674e-ce35-44e8-aedf-24db6a67f5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.847190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836674e-ce35-44e8-aedf-24db6a67f5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:11.849985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836674e-ce35-44e8-aedf-24db6a67f5ce admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:11.868954 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af382-efb7-488a-8c43-9522cb5a2135 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:11.869505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1309/2587] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:06:11.881804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651af382-efb7-488a-8c43-9522cb5a2135 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:11.891159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb9f3b-cacf-44b1-bfa7-125f34799a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:11.891889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb9f3b-cacf-44b1-bfa7-125f34799a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.892690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb9f3b-cacf-44b1-bfa7-125f34799a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.893009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb9f3b-cacf-44b1-bfa7-125f34799a98 admin admin] PATH_INFO: `/v3/projects/379faae081c946a0a99f3e28785daf82/users/e9df01af5e574de4babaa0d240965b9a/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.913531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb9f3b-cacf-44b1-bfa7-125f34799a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379faae081c946a0a99f3e28785daf82, user_id=e9df01af5e574de4babaa0d240965b9a, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:11.916175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb9f3b-cacf-44b1-bfa7-125f34799a98 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:11.931047 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1279/2588] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:11 2022] PUT /identity/v3/projects/379faae081c946a0a99f3e28785daf82/users/e9df01af5e574de4babaa0d240965b9a/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:11.942665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41ede-be4e-4c05-ba0b-4d2614e403fe None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:11.942941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41ede-be4e-4c05-ba0b-4d2614e403fe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:11.943218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a41ede-be4e-4c05-ba0b-4d2614e403fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:11.973341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d8a41ede-be4e-4c05-ba0b-4d2614e403fe None None] MFA Rules not processed for user `e9df01af5e574de4babaa0d240965b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:11.974538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d8a41ede-be4e-4c05-ba0b-4d2614e403fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:12.036667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1310/2589] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:12.042044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb9f3b-cacf-44b1-bfa7-125f34799a98 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:12.098509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:12.105293 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb9f3b-cacf-44b1-bfa7-125f34799a98 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:12.111196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681887d6-9db3-4caa-85b3-897fc828192d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:12.111804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681887d6-9db3-4caa-85b3-897fc828192d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.112088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681887d6-9db3-4caa-85b3-897fc828192d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.112364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681887d6-9db3-4caa-85b3-897fc828192d admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.113013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681887d6-9db3-4caa-85b3-897fc828192d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:12.114940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681887d6-9db3-4caa-85b3-897fc828192d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:12.143246 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1280/2590] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:12 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:06:12.147337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a41ede-be4e-4c05-ba0b-4d2614e403fe None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:12.158232 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a41ede-be4e-4c05-ba0b-4d2614e403fe None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:12.216173 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c198ec8-b7e2-4925-8fa4-1fef423c549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:12.216602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198ec8-b7e2-4925-8fa4-1fef423c549d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.216778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198ec8-b7e2-4925-8fa4-1fef423c549d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.217085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198ec8-b7e2-4925-8fa4-1fef423c549d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.217824 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c198ec8-b7e2-4925-8fa4-1fef423c549d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:12.219858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c198ec8-b7e2-4925-8fa4-1fef423c549d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:12.240281 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1311/2591] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:12 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:12.244327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681887d6-9db3-4caa-85b3-897fc828192d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:12.255073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681887d6-9db3-4caa-85b3-897fc828192d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:12.260206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5456a33-6ce4-41c2-af35-4917b0f48bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:12.260806 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456a33-6ce4-41c2-af35-4917b0f48bde admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.261146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456a33-6ce4-41c2-af35-4917b0f48bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.261423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456a33-6ce4-41c2-af35-4917b0f48bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.262059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5456a33-6ce4-41c2-af35-4917b0f48bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:12.263648 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5456a33-6ce4-41c2-af35-4917b0f48bde admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:12.274000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1281/2592] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:12.278038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c198ec8-b7e2-4925-8fa4-1fef423c549d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:12.287957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c198ec8-b7e2-4925-8fa4-1fef423c549d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:12.292389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c1dd7-0d83-42eb-9ece-f70d0f298a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:12.293054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1dd7-0d83-42eb-9ece-f70d0f298a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.293335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1dd7-0d83-42eb-9ece-f70d0f298a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.293605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1dd7-0d83-42eb-9ece-f70d0f298a28 admin admin] PATH_INFO: `/v3/projects/1498b67a6aba46988290c553fb0b21cf/users/34203391a5704af286d53bf631d8d99f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.308852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c1dd7-0d83-42eb-9ece-f70d0f298a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1498b67a6aba46988290c553fb0b21cf, user_id=34203391a5704af286d53bf631d8d99f, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:12.311489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c1dd7-0d83-42eb-9ece-f70d0f298a28 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:12.324672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1312/2593] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:12 2022] PUT /identity/v3/projects/1498b67a6aba46988290c553fb0b21cf/users/34203391a5704af286d53bf631d8d99f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:06:12.328830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5456a33-6ce4-41c2-af35-4917b0f48bde admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:12.339278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5456a33-6ce4-41c2-af35-4917b0f48bde admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:12.394885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bbd99-b4da-445c-af30-b04784b7e0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:12.395427 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bbd99-b4da-445c-af30-b04784b7e0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.395704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bbd99-b4da-445c-af30-b04784b7e0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.395975 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bbd99-b4da-445c-af30-b04784b7e0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.396600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bbd99-b4da-445c-af30-b04784b7e0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:12.398244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bbd99-b4da-445c-af30-b04784b7e0f6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:12.407683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1282/2594] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:12.411892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c1dd7-0d83-42eb-9ece-f70d0f298a28 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:12.421839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c1dd7-0d83-42eb-9ece-f70d0f298a28 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:12.426472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:12.427105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.427380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.427651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] PATH_INFO: `/v3/projects/1498b67a6aba46988290c553fb0b21cf/users/34203391a5704af286d53bf631d8d99f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.430072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1498b67a6aba46988290c553fb0b21cf, user_id=34203391a5704af286d53bf631d8d99f, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:12.432660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:12.442571 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1313/2595] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:12 2022] PUT /identity/v3/projects/1498b67a6aba46988290c553fb0b21cf/users/34203391a5704af286d53bf631d8d99f/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:12.453232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37916-2053-4868-a496-fa4af7b00070 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.453524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37916-2053-4868-a496-fa4af7b00070 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.453803 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37916-2053-4868-a496-fa4af7b00070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.480721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f3e37916-2053-4868-a496-fa4af7b00070 None None] MFA Rules not processed for user `34203391a5704af286d53bf631d8d99f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:12.481958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f3e37916-2053-4868-a496-fa4af7b00070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:12.547910 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1283/2596] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:12.559651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:12.561473 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:12.595044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:12.626293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971e0ac-6022-4cf6-8405-e49ab32317f6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:12.631138 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df47dbf-1bc0-4e96-991b-78759aab59ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:12.632382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47dbf-1bc0-4e96-991b-78759aab59ba service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.632660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47dbf-1bc0-4e96-991b-78759aab59ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.632927 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df47dbf-1bc0-4e96-991b-78759aab59ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.642223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df47dbf-1bc0-4e96-991b-78759aab59ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:12.643744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df47dbf-1bc0-4e96-991b-78759aab59ba service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:12.653320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1314/2597] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:12.744877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e37916-2053-4868-a496-fa4af7b00070 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:12.754919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e37916-2053-4868-a496-fa4af7b00070 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:12.758528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc52a50-1191-4037-adf5-c100b35d0d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:12.759122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52a50-1191-4037-adf5-c100b35d0d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:12.759400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52a50-1191-4037-adf5-c100b35d0d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:12.759673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc52a50-1191-4037-adf5-c100b35d0d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:12.806366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:12.817740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc52a50-1191-4037-adf5-c100b35d0d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:12.819184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc52a50-1191-4037-adf5-c100b35d0d1e service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:12.828346 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1284/2598] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:13.160118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df47dbf-1bc0-4e96-991b-78759aab59ba service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:13.223715 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df47dbf-1bc0-4e96-991b-78759aab59ba service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:13.228185 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:13.228808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:13.229131 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:13.229403 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] PATH_INFO: `/v3/users/e9df01af5e574de4babaa0d240965b9a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:13.230492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9df01af5e574de4babaa0d240965b9a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:13.232388 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:13.278797 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9df01af5e574de4babaa0d240965b9a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.290680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9df01af5e574de4babaa0d240965b9a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.291344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9df01af5e574de4babaa0d240965b9a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.298324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9df01af5e574de4babaa0d240965b9a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.298943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9df01af5e574de4babaa0d240965b9a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.311609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1315/2599] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:13 2022] DELETE /identity/v3/users/e9df01af5e574de4babaa0d240965b9a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:13.316003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7fafe-98f1-44ca-ab21-f6f955307fcc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:13.316289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7fafe-98f1-44ca-ab21-f6f955307fcc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:13.316563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7fafe-98f1-44ca-ab21-f6f955307fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:13.336698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6ff7fafe-98f1-44ca-ab21-f6f955307fcc None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:13.338240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6ff7fafe-98f1-44ca-ab21-f6f955307fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:13.396923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1285/2600] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:13.406628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:13.407963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:13.461858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:13.466318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49d7f-4dd3-4d25-834f-69ed921600fc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:13.471795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb5c6-5177-4c4c-813d-20807be48c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:13.472479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb5c6-5177-4c4c-813d-20807be48c72 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:13.472934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb5c6-5177-4c4c-813d-20807be48c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:13.473522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb5c6-5177-4c4c-813d-20807be48c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:13.483751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb5c6-5177-4c4c-813d-20807be48c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:13.485211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb5c6-5177-4c4c-813d-20807be48c72 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:13.494702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1316/2601] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:13.776706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7fafe-98f1-44ca-ab21-f6f955307fcc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:13.778164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6ff7fafe-98f1-44ca-ab21-f6f955307fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:13.791457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7fafe-98f1-44ca-ab21-f6f955307fcc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:13.796547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:13.797233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:13.797541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:13.797819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] PATH_INFO: `/v3/projects/379faae081c946a0a99f3e28785daf82` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:13.798968 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] RBAC: Authorizing `identity:delete_project(project_id=379faae081c946a0a99f3e28785daf82)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:13.800898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:13.853524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379faae081c946a0a99f3e28785daf82', 'request_id': 'req-a7b284f7-01c4-4020-aedf-ca5b83e724df'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.859132 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379faae081c946a0a99f3e28785daf82', 'request_id': 'req-a7b284f7-01c4-4020-aedf-ca5b83e724df'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.865154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379faae081c946a0a99f3e28785daf82', 'request_id': 'req-a7b284f7-01c4-4020-aedf-ca5b83e724df'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.877094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] The token cache is being invalidate because project 379faae081c946a0a99f3e28785daf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:13.877422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.878055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:13.879531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1286/2602] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:13 2022] DELETE /identity/v3/projects/379faae081c946a0a99f3e28785daf82 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:13.883515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb5c6-5177-4c4c-813d-20807be48c72 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:13.893100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb5c6-5177-4c4c-813d-20807be48c72 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:13.948158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:13.948697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:13.948999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:13.949273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] PATH_INFO: `/v3/users/34203391a5704af286d53bf631d8d99f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:13.950634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34203391a5704af286d53bf631d8d99f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:13.952520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:13.995843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34203391a5704af286d53bf631d8d99f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.007233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34203391a5704af286d53bf631d8d99f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.007869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34203391a5704af286d53bf631d8d99f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.014161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34203391a5704af286d53bf631d8d99f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.014921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-603de89a-cee1-4062-9820-ef65215af6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34203391a5704af286d53bf631d8d99f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.029941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1317/2603] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:13 2022] DELETE /identity/v3/users/34203391a5704af286d53bf631d8d99f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:14.407484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:14.410243 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:14.428825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b284f7-01c4-4020-aedf-ca5b83e724df admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:14.491298 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:14.491932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.492216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.492494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] PATH_INFO: `/v3/projects/1498b67a6aba46988290c553fb0b21cf` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.493634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1498b67a6aba46988290c553fb0b21cf)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:14.495538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:14.511457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:14.541642 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1498b67a6aba46988290c553fb0b21cf', 'request_id': 'req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.547240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1498b67a6aba46988290c553fb0b21cf', 'request_id': 'req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.553489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1498b67a6aba46988290c553fb0b21cf', 'request_id': 'req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.565821 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] The token cache is being invalidate because project 1498b67a6aba46988290c553fb0b21cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:14.566204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.566951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e8a71e40-617a-4fe0-8ebe-21dc07cc53c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:14.568624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1287/2604] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:14 2022] DELETE /identity/v3/projects/1498b67a6aba46988290c553fb0b21cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:14.574129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350427b-0497-4c37-bde8-1f9f6fe7116f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.574422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350427b-0497-4c37-bde8-1f9f6fe7116f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.574706 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350427b-0497-4c37-bde8-1f9f6fe7116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.594311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2350427b-0497-4c37-bde8-1f9f6fe7116f None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:14.595507 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2350427b-0497-4c37-bde8-1f9f6fe7116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:14.653960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1318/2605] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:14.661967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287d4a-3cd9-4ab0-aaac-43eedf976fbe None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.662252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287d4a-3cd9-4ab0-aaac-43eedf976fbe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.662524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2287d4a-3cd9-4ab0-aaac-43eedf976fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.682653 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f2287d4a-3cd9-4ab0-aaac-43eedf976fbe None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:14.683839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f2287d4a-3cd9-4ab0-aaac-43eedf976fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:14.691633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1288/2606] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:14.696240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350427b-0497-4c37-bde8-1f9f6fe7116f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:14.705939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350427b-0497-4c37-bde8-1f9f6fe7116f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:14.710486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:14.711010 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.711287 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.711555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.712188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:06:14.712491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:14.714094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:14.720552 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:14.729521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1319/2607] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:06:14.730613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2287d4a-3cd9-4ab0-aaac-43eedf976fbe None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:14.739698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2287d4a-3cd9-4ab0-aaac-43eedf976fbe None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:14.744817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ae346-7197-40cf-a434-2e8410a92df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:14.745454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ae346-7197-40cf-a434-2e8410a92df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.745733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ae346-7197-40cf-a434-2e8410a92df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.746003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ae346-7197-40cf-a434-2e8410a92df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.746622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ae346-7197-40cf-a434-2e8410a92df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:14.748502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ae346-7197-40cf-a434-2e8410a92df0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:14.775615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1289/2608] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:14 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:06:14.779636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:14.789487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584e7dc-6ea8-48f8-8cc5-42faa18e58c9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:14.846205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e11f7-42fb-447c-810a-686d2d3c2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:14.846811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e11f7-42fb-447c-810a-686d2d3c2ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.847090 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e11f7-42fb-447c-810a-686d2d3c2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.847360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e11f7-42fb-447c-810a-686d2d3c2ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.847998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e11f7-42fb-447c-810a-686d2d3c2ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:14.849966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e11f7-42fb-447c-810a-686d2d3c2ff1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:14.871161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1320/2609] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:14 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:06:14.875287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ae346-7197-40cf-a434-2e8410a92df0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:14.885970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ae346-7197-40cf-a434-2e8410a92df0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:14.890566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033bb31-f310-44f8-8e5b-bf2956d9b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:14.891158 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033bb31-f310-44f8-8e5b-bf2956d9b801 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.891440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033bb31-f310-44f8-8e5b-bf2956d9b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.891714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033bb31-f310-44f8-8e5b-bf2956d9b801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.892347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033bb31-f310-44f8-8e5b-bf2956d9b801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:14.893995 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033bb31-f310-44f8-8e5b-bf2956d9b801 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:14.903666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1290/2610] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:14.907440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e11f7-42fb-447c-810a-686d2d3c2ff1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:14.917697 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e11f7-42fb-447c-810a-686d2d3c2ff1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:14.922567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91839422-70ca-4b02-9828-3e999b2ec650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:14.923180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91839422-70ca-4b02-9828-3e999b2ec650 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.923448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91839422-70ca-4b02-9828-3e999b2ec650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.923721 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91839422-70ca-4b02-9828-3e999b2ec650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.924365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91839422-70ca-4b02-9828-3e999b2ec650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:14.926427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91839422-70ca-4b02-9828-3e999b2ec650 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:14.938110 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1321/2611] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:14.942094 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033bb31-f310-44f8-8e5b-bf2956d9b801 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:14.955127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033bb31-f310-44f8-8e5b-bf2956d9b801 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:14.961724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03155462-566c-44c5-a2c6-0bfd6f688488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:14.961907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03155462-566c-44c5-a2c6-0bfd6f688488 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:14.962140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03155462-566c-44c5-a2c6-0bfd6f688488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:14.962352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03155462-566c-44c5-a2c6-0bfd6f688488 admin admin] PATH_INFO: `/v3/projects/59b53bdc223341e68c8c88ea214ce1a8/users/f5d3aac0ca6345e8af77de0581548395/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:14.989622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03155462-566c-44c5-a2c6-0bfd6f688488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b53bdc223341e68c8c88ea214ce1a8, user_id=f5d3aac0ca6345e8af77de0581548395, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:14.993680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03155462-566c-44c5-a2c6-0bfd6f688488 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.064875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1291/2612] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:14 2022] PUT /identity/v3/projects/59b53bdc223341e68c8c88ea214ce1a8/users/f5d3aac0ca6345e8af77de0581548395/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:15.076413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92054-d24b-4007-b318-d738aff896f6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.076698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92054-d24b-4007-b318-d738aff896f6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.077057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92054-d24b-4007-b318-d738aff896f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.106719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-49d92054-d24b-4007-b318-d738aff896f6 None None] MFA Rules not processed for user `f5d3aac0ca6345e8af77de0581548395`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:15.107953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-49d92054-d24b-4007-b318-d738aff896f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:15.178057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1322/2613] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:15.183102 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03155462-566c-44c5-a2c6-0bfd6f688488 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.251029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03155462-566c-44c5-a2c6-0bfd6f688488 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.255636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b32e5-f8d5-45c0-9d79-cfe7d196a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.256235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b32e5-f8d5-45c0-9d79-cfe7d196a3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.256515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b32e5-f8d5-45c0-9d79-cfe7d196a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.256832 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b32e5-f8d5-45c0-9d79-cfe7d196a3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.257491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b32e5-f8d5-45c0-9d79-cfe7d196a3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:15.259440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b32e5-f8d5-45c0-9d79-cfe7d196a3e0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.287193 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1292/2614] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:15 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:15.291786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d92054-d24b-4007-b318-d738aff896f6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.302711 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d92054-d24b-4007-b318-d738aff896f6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.360670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aff9c6-ee42-49ea-9dd7-40c254ade5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.361320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aff9c6-ee42-49ea-9dd7-40c254ade5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.361599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aff9c6-ee42-49ea-9dd7-40c254ade5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.361870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aff9c6-ee42-49ea-9dd7-40c254ade5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.362540 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aff9c6-ee42-49ea-9dd7-40c254ade5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:15.364485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aff9c6-ee42-49ea-9dd7-40c254ade5e8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.376926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:15.391586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1323/2615] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:15 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:15.392801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b32e5-f8d5-45c0-9d79-cfe7d196a3e0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.404274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b32e5-f8d5-45c0-9d79-cfe7d196a3e0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.410296 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1e88-90cc-42e0-b37f-0075fa857c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.410907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1e88-90cc-42e0-b37f-0075fa857c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.411171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1e88-90cc-42e0-b37f-0075fa857c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.411438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1e88-90cc-42e0-b37f-0075fa857c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.412071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a1e88-90cc-42e0-b37f-0075fa857c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:15.413844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a1e88-90cc-42e0-b37f-0075fa857c07 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.425863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1293/2616] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:15.430224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aff9c6-ee42-49ea-9dd7-40c254ade5e8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.441678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aff9c6-ee42-49ea-9dd7-40c254ade5e8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.447563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf60d69-9103-4fa0-8def-892d643c5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.448436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60d69-9103-4fa0-8def-892d643c5507 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.448791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60d69-9103-4fa0-8def-892d643c5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.449191 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf60d69-9103-4fa0-8def-892d643c5507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.449930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf60d69-9103-4fa0-8def-892d643c5507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:15.452023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf60d69-9103-4fa0-8def-892d643c5507 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.464838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1324/2617] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:15.468948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1e88-90cc-42e0-b37f-0075fa857c07 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.481672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1e88-90cc-42e0-b37f-0075fa857c07 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.487473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ef78-c365-4bc7-8faf-52de54c17dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.488167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ef78-c365-4bc7-8faf-52de54c17dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.488447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ef78-c365-4bc7-8faf-52de54c17dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.488722 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896ef78-c365-4bc7-8faf-52de54c17dc0 admin admin] PATH_INFO: `/v3/projects/b4def6b83b8a428eb7eb9087cbad30f1/users/a59c10c181a946c1b1e54c3334eac2eb/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.504673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:15.511184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896ef78-c365-4bc7-8faf-52de54c17dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4def6b83b8a428eb7eb9087cbad30f1, user_id=a59c10c181a946c1b1e54c3334eac2eb, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:15.514272 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896ef78-c365-4bc7-8faf-52de54c17dc0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.531692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1294/2618] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:15 2022] PUT /identity/v3/projects/b4def6b83b8a428eb7eb9087cbad30f1/users/a59c10c181a946c1b1e54c3334eac2eb/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:15.542476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a49ee-206f-4964-a24b-2e8daffed598 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.542905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a49ee-206f-4964-a24b-2e8daffed598 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.543184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a49ee-206f-4964-a24b-2e8daffed598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.591870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b29a49ee-206f-4964-a24b-2e8daffed598 None None] MFA Rules not processed for user `a59c10c181a946c1b1e54c3334eac2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:15.593546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b29a49ee-206f-4964-a24b-2e8daffed598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:15.684210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1325/2619] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:15.688369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ef78-c365-4bc7-8faf-52de54c17dc0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.759300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896ef78-c365-4bc7-8faf-52de54c17dc0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.764006 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374cfd4-a6f7-465f-b879-58cc817d6f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.764622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374cfd4-a6f7-465f-b879-58cc817d6f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.764904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374cfd4-a6f7-465f-b879-58cc817d6f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.765227 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374cfd4-a6f7-465f-b879-58cc817d6f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.765861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374cfd4-a6f7-465f-b879-58cc817d6f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:15.767770 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374cfd4-a6f7-465f-b879-58cc817d6f2b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.798857 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1295/2620] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:15 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:15.803560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a49ee-206f-4964-a24b-2e8daffed598 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.820855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a49ee-206f-4964-a24b-2e8daffed598 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.887342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51b8f3-952d-4be6-a929-621c551c02b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.887956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51b8f3-952d-4be6-a929-621c551c02b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.888238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51b8f3-952d-4be6-a929-621c551c02b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.888517 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51b8f3-952d-4be6-a929-621c551c02b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.889200 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51b8f3-952d-4be6-a929-621c551c02b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:15.891103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51b8f3-952d-4be6-a929-621c551c02b9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.922406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1326/2621] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:15 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:15.926592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374cfd4-a6f7-465f-b879-58cc817d6f2b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.939924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374cfd4-a6f7-465f-b879-58cc817d6f2b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.945998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9f2e-6793-4bd7-b195-f08d5f2e48ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.946673 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9f2e-6793-4bd7-b195-f08d5f2e48ef admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.947020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9f2e-6793-4bd7-b195-f08d5f2e48ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.947380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef9f2e-6793-4bd7-b195-f08d5f2e48ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.948086 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9f2e-6793-4bd7-b195-f08d5f2e48ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:15.949840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef9f2e-6793-4bd7-b195-f08d5f2e48ef admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:15.961919 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1296/2622] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:06:15.966402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51b8f3-952d-4be6-a929-621c551c02b9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:15.977008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51b8f3-952d-4be6-a929-621c551c02b9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:15.982930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e83d3-54a8-4b42-bf75-6f552cf16f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:15.983618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e83d3-54a8-4b42-bf75-6f552cf16f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:15.983914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e83d3-54a8-4b42-bf75-6f552cf16f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:15.984175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e83d3-54a8-4b42-bf75-6f552cf16f38 admin admin] PATH_INFO: `/v3/projects/f8fadb41cb9a4d4890d5017bb5d99d9a/users/abee3e7f568347afa1d8d986104950f5/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:15.999316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e83d3-54a8-4b42-bf75-6f552cf16f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fadb41cb9a4d4890d5017bb5d99d9a, user_id=abee3e7f568347afa1d8d986104950f5, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:16.001999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e83d3-54a8-4b42-bf75-6f552cf16f38 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:16.015182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1327/2623] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:15 2022] PUT /identity/v3/projects/f8fadb41cb9a4d4890d5017bb5d99d9a/users/abee3e7f568347afa1d8d986104950f5/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:16.019083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9f2e-6793-4bd7-b195-f08d5f2e48ef admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:16.029549 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef9f2e-6793-4bd7-b195-f08d5f2e48ef admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:16.088949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6e2f-70bf-4bef-9b4d-bf5ee4aa856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:16.089589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6e2f-70bf-4bef-9b4d-bf5ee4aa856d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:16.089870 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6e2f-70bf-4bef-9b4d-bf5ee4aa856d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:16.090170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6e2f-70bf-4bef-9b4d-bf5ee4aa856d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:16.090800 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b6e2f-70bf-4bef-9b4d-bf5ee4aa856d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:16.092409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b6e2f-70bf-4bef-9b4d-bf5ee4aa856d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:16.102181 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1297/2624] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:16.106661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e83d3-54a8-4b42-bf75-6f552cf16f38 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:16.117567 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e83d3-54a8-4b42-bf75-6f552cf16f38 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:16.122328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:16.123063 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:16.123513 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:16.123857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] PATH_INFO: `/v3/projects/f8fadb41cb9a4d4890d5017bb5d99d9a/users/abee3e7f568347afa1d8d986104950f5/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:16.125947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fadb41cb9a4d4890d5017bb5d99d9a, user_id=abee3e7f568347afa1d8d986104950f5, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:16.128547 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:16.139963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1328/2625] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:16 2022] PUT /identity/v3/projects/f8fadb41cb9a4d4890d5017bb5d99d9a/users/abee3e7f568347afa1d8d986104950f5/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:06:16.150048 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988baa20-2ae0-462e-8fc4-e7cbcd980fb3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:16.150339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988baa20-2ae0-462e-8fc4-e7cbcd980fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:16.150611 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988baa20-2ae0-462e-8fc4-e7cbcd980fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:16.179229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-988baa20-2ae0-462e-8fc4-e7cbcd980fb3 None None] MFA Rules not processed for user `abee3e7f568347afa1d8d986104950f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:16.181317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-988baa20-2ae0-462e-8fc4-e7cbcd980fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:16.228295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:16.250872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1298/2626] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:16.262067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:16.263819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:16.294811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:16.321665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b837b30-ab04-4fe8-bcca-0ce718331351 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:16.325317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:16.326182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:16.326460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:16.326731 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:16.381065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:16.382526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:16.391289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1329/2627] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:17.430253 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9ebd4-810c-4942-8feb-2bd3e1e2168b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:17.430743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9ebd4-810c-4942-8feb-2bd3e1e2168b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:17.430863 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9ebd4-810c-4942-8feb-2bd3e1e2168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:17.450893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3ff9ebd4-810c-4942-8feb-2bd3e1e2168b None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:17.452130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3ff9ebd4-810c-4942-8feb-2bd3e1e2168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:17.506283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1299/2628] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 10 12:06:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:17.519578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:17.521060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:17.591395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8a79b-f287-4061-8771-220a4c005b9d service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:17.596378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec721f-0e34-453c-a440-6e5b5b496195 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:17.596990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec721f-0e34-453c-a440-6e5b5b496195 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:17.597288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec721f-0e34-453c-a440-6e5b5b496195 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:17.597560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec721f-0e34-453c-a440-6e5b5b496195 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:17.605810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec721f-0e34-453c-a440-6e5b5b496195 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:17.607417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec721f-0e34-453c-a440-6e5b5b496195 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:17.615285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1330/2629] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:06:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:06:17.914327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9ebd4-810c-4942-8feb-2bd3e1e2168b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:17.915851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3ff9ebd4-810c-4942-8feb-2bd3e1e2168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:17.937596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9ebd4-810c-4942-8feb-2bd3e1e2168b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:17.941417 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bc525-c237-44fb-aef3-b4a0ea7343ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:17.942050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bc525-c237-44fb-aef3-b4a0ea7343ab service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:17.942329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bc525-c237-44fb-aef3-b4a0ea7343ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:17.942600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bc525-c237-44fb-aef3-b4a0ea7343ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:18.005323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bc525-c237-44fb-aef3-b4a0ea7343ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:18.006760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bc525-c237-44fb-aef3-b4a0ea7343ab service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:18.016373 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1300/2630] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:18.562791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec721f-0e34-453c-a440-6e5b5b496195 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:18.573420 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec721f-0e34-453c-a440-6e5b5b496195 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:18.577274 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1ae67-e1f6-4009-94bd-46079c564372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:18.577997 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ae67-e1f6-4009-94bd-46079c564372 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:18.578280 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ae67-e1f6-4009-94bd-46079c564372 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:18.578557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ae67-e1f6-4009-94bd-46079c564372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:18.587462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1ae67-e1f6-4009-94bd-46079c564372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:18.588912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1ae67-e1f6-4009-94bd-46079c564372 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:18.598215 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1331/2631] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:22.455812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bc525-c237-44fb-aef3-b4a0ea7343ab service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:22.516190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bc525-c237-44fb-aef3-b4a0ea7343ab service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:22.520655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:22.521304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:22.521587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:22.521861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] PATH_INFO: `/v3/users/f5d3aac0ca6345e8af77de0581548395` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:22.523488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d3aac0ca6345e8af77de0581548395)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:22.525430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:22.557909 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:22.574727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d3aac0ca6345e8af77de0581548395'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:22.588481 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d3aac0ca6345e8af77de0581548395'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:22.589335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d3aac0ca6345e8af77de0581548395'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:22.597339 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d3aac0ca6345e8af77de0581548395'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:22.598139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d3aac0ca6345e8af77de0581548395'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:22.610471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1301/2632] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:22 2022] DELETE /identity/v3/users/f5d3aac0ca6345e8af77de0581548395 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:22.615051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99e88-3f70-4d2b-893a-55f46d3be568 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:22.615532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99e88-3f70-4d2b-893a-55f46d3be568 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:22.615653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99e88-3f70-4d2b-893a-55f46d3be568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:22.635606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bbb99e88-3f70-4d2b-893a-55f46d3be568 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:22.636925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bbb99e88-3f70-4d2b-893a-55f46d3be568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:22.689220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:22.699526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1332/2633] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:22.709631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:22.711711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:22.768473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c19d8-848c-431b-82b4-db0fffd5d0fe admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:22.772375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5077b5-1968-4339-9d6d-00c22848df0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:22.773588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5077b5-1968-4339-9d6d-00c22848df0b service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:22.773866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5077b5-1968-4339-9d6d-00c22848df0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:22.774138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5077b5-1968-4339-9d6d-00c22848df0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:22.782974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5077b5-1968-4339-9d6d-00c22848df0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:22.784381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5077b5-1968-4339-9d6d-00c22848df0b service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:22.793569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1302/2634] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:23.058194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb99e88-3f70-4d2b-893a-55f46d3be568 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:23.059650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bbb99e88-3f70-4d2b-893a-55f46d3be568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:23.071652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb99e88-3f70-4d2b-893a-55f46d3be568 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:23.076378 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:23.077031 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:23.077314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:23.077586 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] PATH_INFO: `/v3/projects/59b53bdc223341e68c8c88ea214ce1a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:23.078693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b53bdc223341e68c8c88ea214ce1a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:23.080601 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:23.126707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b53bdc223341e68c8c88ea214ce1a8', 'request_id': 'req-7222f4f9-dd04-4bde-b2b2-949575f14924'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.132155 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b53bdc223341e68c8c88ea214ce1a8', 'request_id': 'req-7222f4f9-dd04-4bde-b2b2-949575f14924'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.138093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b53bdc223341e68c8c88ea214ce1a8', 'request_id': 'req-7222f4f9-dd04-4bde-b2b2-949575f14924'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.150821 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] The token cache is being invalidate because project 59b53bdc223341e68c8c88ea214ce1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:23.151118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.151752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.153259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1333/2635] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:23 2022] DELETE /identity/v3/projects/59b53bdc223341e68c8c88ea214ce1a8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:23.157342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5077b5-1968-4339-9d6d-00c22848df0b service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:23.167682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5077b5-1968-4339-9d6d-00c22848df0b service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:23.222802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:23.223353 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:23.223629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:23.223897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] PATH_INFO: `/v3/users/a59c10c181a946c1b1e54c3334eac2eb` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:23.225052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59c10c181a946c1b1e54c3334eac2eb)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:23.227106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:23.272058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59c10c181a946c1b1e54c3334eac2eb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.276997 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:23.286600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59c10c181a946c1b1e54c3334eac2eb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.287263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59c10c181a946c1b1e54c3334eac2eb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.294238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59c10c181a946c1b1e54c3334eac2eb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.294858 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59c10c181a946c1b1e54c3334eac2eb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.306754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1303/2636] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:23 2022] DELETE /identity/v3/users/a59c10c181a946c1b1e54c3334eac2eb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:23.575703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:23.577694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:23.591543 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f4f9-dd04-4bde-b2b2-949575f14924 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:23.646872 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:23.647514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:23.648246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:23.648523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] PATH_INFO: `/v3/projects/b4def6b83b8a428eb7eb9087cbad30f1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:23.649642 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4def6b83b8a428eb7eb9087cbad30f1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:23.651521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:23.695368 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4def6b83b8a428eb7eb9087cbad30f1', 'request_id': 'req-37bf62c5-09b3-409b-82da-32ef016a6228'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.700715 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4def6b83b8a428eb7eb9087cbad30f1', 'request_id': 'req-37bf62c5-09b3-409b-82da-32ef016a6228'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.706856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4def6b83b8a428eb7eb9087cbad30f1', 'request_id': 'req-37bf62c5-09b3-409b-82da-32ef016a6228'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.719403 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] The token cache is being invalidate because project b4def6b83b8a428eb7eb9087cbad30f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:23.719687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.720310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.721828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1334/2637] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:23 2022] DELETE /identity/v3/projects/b4def6b83b8a428eb7eb9087cbad30f1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:23.725768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:23.727255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:23.739689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf24ba-a540-47d0-af5b-99a64812f69c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:23.796828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:23.797492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:23.797773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:23.798050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] PATH_INFO: `/v3/users/abee3e7f568347afa1d8d986104950f5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:23.799173 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abee3e7f568347afa1d8d986104950f5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:23.801108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:23.852662 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abee3e7f568347afa1d8d986104950f5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.864681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abee3e7f568347afa1d8d986104950f5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.865458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abee3e7f568347afa1d8d986104950f5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.873903 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abee3e7f568347afa1d8d986104950f5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.874667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e7218dd0-94e4-4436-a943-d92eb751398d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abee3e7f568347afa1d8d986104950f5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:23.888274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1304/2638] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:23 2022] DELETE /identity/v3/users/abee3e7f568347afa1d8d986104950f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:24.155594 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:24.157166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:24.171960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf62c5-09b3-409b-82da-32ef016a6228 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:24.181050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:24.231382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:24.232008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.232288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.232559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] PATH_INFO: `/v3/projects/f8fadb41cb9a4d4890d5017bb5d99d9a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.233687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8fadb41cb9a4d4890d5017bb5d99d9a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:24.235573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:24.282523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fadb41cb9a4d4890d5017bb5d99d9a', 'request_id': 'req-c133d6ba-6463-4be2-a589-4be930579c37'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:24.288025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fadb41cb9a4d4890d5017bb5d99d9a', 'request_id': 'req-c133d6ba-6463-4be2-a589-4be930579c37'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:24.294120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fadb41cb9a4d4890d5017bb5d99d9a', 'request_id': 'req-c133d6ba-6463-4be2-a589-4be930579c37'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:24.306572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] The token cache is being invalidate because project f8fadb41cb9a4d4890d5017bb5d99d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:24.306860 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:24.307481 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c133d6ba-6463-4be2-a589-4be930579c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:24.308966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1335/2639] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:24 2022] DELETE /identity/v3/projects/f8fadb41cb9a4d4890d5017bb5d99d9a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:24.313796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb811-6e47-4000-9c9f-f85794e4a7ce None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.314088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb811-6e47-4000-9c9f-f85794e4a7ce None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.314366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb811-6e47-4000-9c9f-f85794e4a7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.334214 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-db7cb811-6e47-4000-9c9f-f85794e4a7ce None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:24.335974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-db7cb811-6e47-4000-9c9f-f85794e4a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:24.378539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:24.395212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1305/2640] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:24.402868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530701f-c8a7-4394-90fb-a2b457afb89c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.403155 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530701f-c8a7-4394-90fb-a2b457afb89c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.403431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530701f-c8a7-4394-90fb-a2b457afb89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.422722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0530701f-c8a7-4394-90fb-a2b457afb89c None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:24.423908 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0530701f-c8a7-4394-90fb-a2b457afb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:24.432137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1336/2641] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:24.436170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cb811-6e47-4000-9c9f-f85794e4a7ce None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:24.446613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cb811-6e47-4000-9c9f-f85794e4a7ce None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:24.451474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:24.452071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.452351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.452654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.453342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:06:24.453649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:24.455238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:24.466685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1306/2642] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:06:24.470782 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530701f-c8a7-4394-90fb-a2b457afb89c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:24.479819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530701f-c8a7-4394-90fb-a2b457afb89c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:24.484609 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178f73f-2979-4aab-a0e0-c747c71b98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:24.485240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f73f-2979-4aab-a0e0-c747c71b98fb admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.485521 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f73f-2979-4aab-a0e0-c747c71b98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.485802 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f73f-2979-4aab-a0e0-c747c71b98fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.486431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178f73f-2979-4aab-a0e0-c747c71b98fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:24.488349 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178f73f-2979-4aab-a0e0-c747c71b98fb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:24.516179 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1337/2643] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:06:24 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:24.520191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:24.529906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8346-1573-4b54-8d44-0b43d856a787 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:24.586966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88736deb-154a-4cd5-bcc1-ad404a118bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:24.587499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88736deb-154a-4cd5-bcc1-ad404a118bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.587832 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88736deb-154a-4cd5-bcc1-ad404a118bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.588105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88736deb-154a-4cd5-bcc1-ad404a118bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.588734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88736deb-154a-4cd5-bcc1-ad404a118bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:24.590680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88736deb-154a-4cd5-bcc1-ad404a118bb5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:24.611374 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1307/2644] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:06:24 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:06:24.615489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178f73f-2979-4aab-a0e0-c747c71b98fb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:24.626157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178f73f-2979-4aab-a0e0-c747c71b98fb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:24.630712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44ce0a-0dce-4f8a-870a-e917ae41deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:24.631305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44ce0a-0dce-4f8a-870a-e917ae41deec admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.631585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44ce0a-0dce-4f8a-870a-e917ae41deec admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.631853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44ce0a-0dce-4f8a-870a-e917ae41deec admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.633106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44ce0a-0dce-4f8a-870a-e917ae41deec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:24.634703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44ce0a-0dce-4f8a-870a-e917ae41deec admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:24.644779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1338/2645] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:06:24.648643 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88736deb-154a-4cd5-bcc1-ad404a118bb5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:24.659016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88736deb-154a-4cd5-bcc1-ad404a118bb5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:24.663716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e50f3-caaa-449a-b4f1-7d0f02f376ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:24.664304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e50f3-caaa-449a-b4f1-7d0f02f376ad admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.664607 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e50f3-caaa-449a-b4f1-7d0f02f376ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.664886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e50f3-caaa-449a-b4f1-7d0f02f376ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.665708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e50f3-caaa-449a-b4f1-7d0f02f376ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:24.667429 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e50f3-caaa-449a-b4f1-7d0f02f376ad admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:24.678029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1308/2646] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:06:24.682738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44ce0a-0dce-4f8a-870a-e917ae41deec admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:24.692724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44ce0a-0dce-4f8a-870a-e917ae41deec admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:24.697496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:24.698137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.698416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.698689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] PATH_INFO: `/v3/projects/7ed55fb0a62347cfa79a881f5a0c5bb7/users/e5dcc10b8b274d7fa0b2a8e989d0a9ad/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.714051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed55fb0a62347cfa79a881f5a0c5bb7, user_id=e5dcc10b8b274d7fa0b2a8e989d0a9ad, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:24.716673 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:24.730119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1339/2647] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:06:24 2022] PUT /identity/v3/projects/7ed55fb0a62347cfa79a881f5a0c5bb7/users/e5dcc10b8b274d7fa0b2a8e989d0a9ad/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:24.740270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a557-4fd3-4507-a5d1-6a2ad8699d38 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.740759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a557-4fd3-4507-a5d1-6a2ad8699d38 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.740861 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a557-4fd3-4507-a5d1-6a2ad8699d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.770031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-65e0a557-4fd3-4507-a5d1-6a2ad8699d38 None None] MFA Rules not processed for user `e5dcc10b8b274d7fa0b2a8e989d0a9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:24.771432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-65e0a557-4fd3-4507-a5d1-6a2ad8699d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:24.836889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1309/2648] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:24.847794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:24.849704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:24.890505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:24.907336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ca0b8-c93b-481e-8812-683d36be29ad admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:24.910948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb75bb0-f501-49d2-9a45-cab443dabdbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:24.911548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75bb0-f501-49d2-9a45-cab443dabdbf service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:24.911826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75bb0-f501-49d2-9a45-cab443dabdbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:24.912099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75bb0-f501-49d2-9a45-cab443dabdbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:24.920139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb75bb0-f501-49d2-9a45-cab443dabdbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:24.921592 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb75bb0-f501-49d2-9a45-cab443dabdbf service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:24.930541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1340/2649] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:34.833341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:34.926360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=9 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:35.108557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0a557-4fd3-4507-a5d1-6a2ad8699d38 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:35.168993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0a557-4fd3-4507-a5d1-6a2ad8699d38 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:35.173622 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:35.174239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:35.174516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:35.174786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] PATH_INFO: `/v3/users/e5dcc10b8b274d7fa0b2a8e989d0a9ad` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:35.175883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5dcc10b8b274d7fa0b2a8e989d0a9ad)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:35.177871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:35.224123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5dcc10b8b274d7fa0b2a8e989d0a9ad'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.236519 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5dcc10b8b274d7fa0b2a8e989d0a9ad'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.237217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5dcc10b8b274d7fa0b2a8e989d0a9ad'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.244958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5dcc10b8b274d7fa0b2a8e989d0a9ad'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.245596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5dcc10b8b274d7fa0b2a8e989d0a9ad'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.257568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1310/2650] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:06:35 2022] DELETE /identity/v3/users/e5dcc10b8b274d7fa0b2a8e989d0a9ad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:35.262292 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329841fe-e030-48be-8175-75ff1113eda4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:35.262585 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329841fe-e030-48be-8175-75ff1113eda4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:35.262862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329841fe-e030-48be-8175-75ff1113eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:35.281867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-329841fe-e030-48be-8175-75ff1113eda4 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:06:35.283097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-329841fe-e030-48be-8175-75ff1113eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:35.340269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1341/2651] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:06:35.350021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:35.351419 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:35.406768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524823b9-e331-427b-8eeb-59429c46902c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:35.410449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dec18-bb66-4f91-bbe8-a6d8558c140e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:35.411044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dec18-bb66-4f91-bbe8-a6d8558c140e service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:35.411319 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dec18-bb66-4f91-bbe8-a6d8558c140e service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:35.411587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dec18-bb66-4f91-bbe8-a6d8558c140e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:35.420359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dec18-bb66-4f91-bbe8-a6d8558c140e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:35.421798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dec18-bb66-4f91-bbe8-a6d8558c140e service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:35.431080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1311/2652] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:06:35.733194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329841fe-e030-48be-8175-75ff1113eda4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:35.734667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-329841fe-e030-48be-8175-75ff1113eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:35.748145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329841fe-e030-48be-8175-75ff1113eda4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:35.753436 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:35.754078 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:35.754355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:35.754628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] PATH_INFO: `/v3/projects/7ed55fb0a62347cfa79a881f5a0c5bb7` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:35.755753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed55fb0a62347cfa79a881f5a0c5bb7)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:35.757709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:35.810129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed55fb0a62347cfa79a881f5a0c5bb7', 'request_id': 'req-3857f101-35e9-4f95-9096-2341efec42ed'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.817660 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed55fb0a62347cfa79a881f5a0c5bb7', 'request_id': 'req-3857f101-35e9-4f95-9096-2341efec42ed'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.825257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed55fb0a62347cfa79a881f5a0c5bb7', 'request_id': 'req-3857f101-35e9-4f95-9096-2341efec42ed'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.841260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] The token cache is being invalidate because project 7ed55fb0a62347cfa79a881f5a0c5bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:06:35.841555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.842195 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:06:35.843682 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1342/2653] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:06:35 2022] DELETE /identity/v3/projects/7ed55fb0a62347cfa79a881f5a0c5bb7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:06:45.426891 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:45.837220 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:06:57.382650 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dec18-bb66-4f91-bbe8-a6d8558c140e service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:06:57.391251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dec18-bb66-4f91-bbe8-a6d8558c140e service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:06:57.438860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:06:57.439460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:06:57.439740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:06:57.440009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:06:57.441761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:06:57.502469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:06:57.503953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:06:57.513609 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1312/2654] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:00.590187 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:00.591719 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:00.605054 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f101-35e9-4f95-9096-2341efec42ed admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:00.609658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:00.610288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:00.610566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:00.610835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] PATH_INFO: `/v3/users/549d0ae567994dc5b58f24fbb614363b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:00.611974 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=549d0ae567994dc5b58f24fbb614363b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:00.613930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:00.660751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549d0ae567994dc5b58f24fbb614363b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:00.673589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549d0ae567994dc5b58f24fbb614363b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:00.674325 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549d0ae567994dc5b58f24fbb614363b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:00.683471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549d0ae567994dc5b58f24fbb614363b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:00.684093 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f951481b-6d80-4b56-93e3-d37dd19f0cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549d0ae567994dc5b58f24fbb614363b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:00.699951 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1343/2655] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:00 2022] DELETE /identity/v3/users/549d0ae567994dc5b58f24fbb614363b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:00.873092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:00.887277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695a4ba-26d4-4e01-b0c3-7fb875139be3 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:00.944191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:00.944819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:00.945136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:00.945412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] PATH_INFO: `/v3/projects/66a0a0d5766e47228f6fdf11f8ec723a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:00.946506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a0a0d5766e47228f6fdf11f8ec723a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:00.948953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:00.993523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a0a0d5766e47228f6fdf11f8ec723a', 'request_id': 'req-6541d8aa-d663-4331-bcc3-90066e131fce'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:00.995487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:01.000264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a0a0d5766e47228f6fdf11f8ec723a', 'request_id': 'req-6541d8aa-d663-4331-bcc3-90066e131fce'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:01.006574 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a0a0d5766e47228f6fdf11f8ec723a', 'request_id': 'req-6541d8aa-d663-4331-bcc3-90066e131fce'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:01.019113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] The token cache is being invalidate because project 66a0a0d5766e47228f6fdf11f8ec723a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:01.019397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:01.020019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6541d8aa-d663-4331-bcc3-90066e131fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:01.021545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1313/2656] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:00 2022] DELETE /identity/v3/projects/66a0a0d5766e47228f6fdf11f8ec723a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:01.027047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28779b28-0b83-4a9a-9a10-bb7b3ca617a1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.027335 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28779b28-0b83-4a9a-9a10-bb7b3ca617a1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.027596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28779b28-0b83-4a9a-9a10-bb7b3ca617a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.046728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-28779b28-0b83-4a9a-9a10-bb7b3ca617a1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:01.047899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-28779b28-0b83-4a9a-9a10-bb7b3ca617a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:01.104113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1344/2657] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:01.112125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fc98e-e7d6-45bb-b1d5-721216ae71ed None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.112407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fc98e-e7d6-45bb-b1d5-721216ae71ed None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.112682 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fc98e-e7d6-45bb-b1d5-721216ae71ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.132322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3f2fc98e-e7d6-45bb-b1d5-721216ae71ed None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:01.133535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3f2fc98e-e7d6-45bb-b1d5-721216ae71ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:01.141406 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1314/2658] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:07:01.145410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28779b28-0b83-4a9a-9a10-bb7b3ca617a1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.155319 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28779b28-0b83-4a9a-9a10-bb7b3ca617a1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.159793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.160380 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.160658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.160926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.161608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:07:01.161909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.163476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.175177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1345/2659] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:07:01.179236 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fc98e-e7d6-45bb-b1d5-721216ae71ed None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.188341 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fc98e-e7d6-45bb-b1d5-721216ae71ed None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.192956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1de23-7a2f-4af7-81be-78f0ce564049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.193566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1de23-7a2f-4af7-81be-78f0ce564049 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.193847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1de23-7a2f-4af7-81be-78f0ce564049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.194118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1de23-7a2f-4af7-81be-78f0ce564049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.194752 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1de23-7a2f-4af7-81be-78f0ce564049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.196782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1de23-7a2f-4af7-81be-78f0ce564049 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.223816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1315/2660] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:01 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:07:01.227905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.237705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a783b0-1265-4f78-980d-cdf049cc134e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.292367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53f6b5-495b-4316-82ff-cbfaf70e3ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.292959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f6b5-495b-4316-82ff-cbfaf70e3ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.293264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f6b5-495b-4316-82ff-cbfaf70e3ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.293533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53f6b5-495b-4316-82ff-cbfaf70e3ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.294158 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53f6b5-495b-4316-82ff-cbfaf70e3ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.296071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53f6b5-495b-4316-82ff-cbfaf70e3ec5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.303882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:01.319086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1346/2661] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:01 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:01.323843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1de23-7a2f-4af7-81be-78f0ce564049 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.334118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1de23-7a2f-4af7-81be-78f0ce564049 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.339054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ca6d4-f7ac-47c6-aa36-dc049451777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.339652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca6d4-f7ac-47c6-aa36-dc049451777b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.339993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca6d4-f7ac-47c6-aa36-dc049451777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.340271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca6d4-f7ac-47c6-aa36-dc049451777b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.340912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ca6d4-f7ac-47c6-aa36-dc049451777b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.342521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ca6d4-f7ac-47c6-aa36-dc049451777b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.352449 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1316/2662] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:01.356394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53f6b5-495b-4316-82ff-cbfaf70e3ec5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.366210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53f6b5-495b-4316-82ff-cbfaf70e3ec5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.371367 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46115-bee4-41ce-8d79-fd65c6574009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.371957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46115-bee4-41ce-8d79-fd65c6574009 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.372241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46115-bee4-41ce-8d79-fd65c6574009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.372516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46115-bee4-41ce-8d79-fd65c6574009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.373181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba46115-bee4-41ce-8d79-fd65c6574009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.374763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba46115-bee4-41ce-8d79-fd65c6574009 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.385055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1347/2663] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:01.389757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ca6d4-f7ac-47c6-aa36-dc049451777b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.399324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ca6d4-f7ac-47c6-aa36-dc049451777b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.403855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50928d35-1fb5-4eb9-96ea-16a5dc5362c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.404572 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50928d35-1fb5-4eb9-96ea-16a5dc5362c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.405061 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50928d35-1fb5-4eb9-96ea-16a5dc5362c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.405397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50928d35-1fb5-4eb9-96ea-16a5dc5362c3 admin admin] PATH_INFO: `/v3/projects/1e1502c400d9431bb984b3add09a7306/users/a3c3370d55bd415992d369824a2877ac/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.419823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50928d35-1fb5-4eb9-96ea-16a5dc5362c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1502c400d9431bb984b3add09a7306, user_id=a3c3370d55bd415992d369824a2877ac, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.422472 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50928d35-1fb5-4eb9-96ea-16a5dc5362c3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.435202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1317/2664] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:01 2022] PUT /identity/v3/projects/1e1502c400d9431bb984b3add09a7306/users/a3c3370d55bd415992d369824a2877ac/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:07:01.447053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903ef1-b7b6-406c-b5c0-d6d4c25170c6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.447422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903ef1-b7b6-406c-b5c0-d6d4c25170c6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.448255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903ef1-b7b6-406c-b5c0-d6d4c25170c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.475573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cb903ef1-b7b6-406c-b5c0-d6d4c25170c6 None None] MFA Rules not processed for user `a3c3370d55bd415992d369824a2877ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:01.476794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cb903ef1-b7b6-406c-b5c0-d6d4c25170c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:01.539726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1348/2665] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:01.544747 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50928d35-1fb5-4eb9-96ea-16a5dc5362c3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.605984 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50928d35-1fb5-4eb9-96ea-16a5dc5362c3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.610601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9949747-b700-48e4-bc6f-8059233d8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.611194 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9949747-b700-48e4-bc6f-8059233d8744 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.611474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9949747-b700-48e4-bc6f-8059233d8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.611746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9949747-b700-48e4-bc6f-8059233d8744 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.612361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9949747-b700-48e4-bc6f-8059233d8744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.614266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9949747-b700-48e4-bc6f-8059233d8744 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.641958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1318/2666] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:01 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:01.645767 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb903ef1-b7b6-406c-b5c0-d6d4c25170c6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.656880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb903ef1-b7b6-406c-b5c0-d6d4c25170c6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.710896 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd855a5a-054c-4b2e-be53-2b711b6fca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.711491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855a5a-054c-4b2e-be53-2b711b6fca4f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.711771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855a5a-054c-4b2e-be53-2b711b6fca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.712043 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855a5a-054c-4b2e-be53-2b711b6fca4f admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.712670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd855a5a-054c-4b2e-be53-2b711b6fca4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.715199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd855a5a-054c-4b2e-be53-2b711b6fca4f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.735433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1349/2667] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:01 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:01.739327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9949747-b700-48e4-bc6f-8059233d8744 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.749482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9949747-b700-48e4-bc6f-8059233d8744 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.754019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4f37b-f6a6-40bf-b000-07f8e1a31d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.754602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f37b-f6a6-40bf-b000-07f8e1a31d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.754881 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f37b-f6a6-40bf-b000-07f8e1a31d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.755195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4f37b-f6a6-40bf-b000-07f8e1a31d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.755827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4f37b-f6a6-40bf-b000-07f8e1a31d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.757438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4f37b-f6a6-40bf-b000-07f8e1a31d69 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.768103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1319/2668] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:01.771961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd855a5a-054c-4b2e-be53-2b711b6fca4f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.782340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd855a5a-054c-4b2e-be53-2b711b6fca4f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.786887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dadd9-d631-4794-933c-2613e760305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.787523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dadd9-d631-4794-933c-2613e760305d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.787801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dadd9-d631-4794-933c-2613e760305d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.788076 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dadd9-d631-4794-933c-2613e760305d admin admin] PATH_INFO: `/v3/projects/6a5cec7d955f40f59648cd8ee55f5d23/users/352bc0e40800425f956aa3ee8d6fb520/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.802497 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dadd9-d631-4794-933c-2613e760305d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5cec7d955f40f59648cd8ee55f5d23, user_id=352bc0e40800425f956aa3ee8d6fb520, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.805146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dadd9-d631-4794-933c-2613e760305d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.818529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1350/2669] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:01 2022] PUT /identity/v3/projects/6a5cec7d955f40f59648cd8ee55f5d23/users/352bc0e40800425f956aa3ee8d6fb520/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:01.823130 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4f37b-f6a6-40bf-b000-07f8e1a31d69 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.833273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4f37b-f6a6-40bf-b000-07f8e1a31d69 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.877839 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:01.889347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3c1d-a3f9-4b6c-8bcf-488128654296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.889945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3c1d-a3f9-4b6c-8bcf-488128654296 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.890222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3c1d-a3f9-4b6c-8bcf-488128654296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.890491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3c1d-a3f9-4b6c-8bcf-488128654296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.891120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b3c1d-a3f9-4b6c-8bcf-488128654296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.892681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b3c1d-a3f9-4b6c-8bcf-488128654296 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.902664 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1320/2670] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:01.907366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dadd9-d631-4794-933c-2613e760305d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:01.918188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dadd9-d631-4794-933c-2613e760305d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:01.922869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:01.923518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.923828 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.924103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] PATH_INFO: `/v3/projects/6a5cec7d955f40f59648cd8ee55f5d23/users/352bc0e40800425f956aa3ee8d6fb520/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.926067 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5cec7d955f40f59648cd8ee55f5d23, user_id=352bc0e40800425f956aa3ee8d6fb520, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:01.928678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:01.938862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1351/2671] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:01 2022] PUT /identity/v3/projects/6a5cec7d955f40f59648cd8ee55f5d23/users/352bc0e40800425f956aa3ee8d6fb520/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:01.948771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde047-ae88-4cc3-86d9-a41a81e39f20 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:01.949093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde047-ae88-4cc3-86d9-a41a81e39f20 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:01.949367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde047-ae88-4cc3-86d9-a41a81e39f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:01.977691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5ddde047-ae88-4cc3-86d9-a41a81e39f20 None None] MFA Rules not processed for user `352bc0e40800425f956aa3ee8d6fb520`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:01.979663 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5ddde047-ae88-4cc3-86d9-a41a81e39f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:02.046655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1321/2672] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:02.057683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:02.059525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:02.081754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:02.117979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c6d7e-dd12-45e1-9a2e-f24e0fedf853 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:02.121614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5b7d6-59c0-411c-9d89-26a7f0cac73c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:02.122208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b7d6-59c0-411c-9d89-26a7f0cac73c service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:02.122486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b7d6-59c0-411c-9d89-26a7f0cac73c service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:02.122756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5b7d6-59c0-411c-9d89-26a7f0cac73c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:02.131490 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5b7d6-59c0-411c-9d89-26a7f0cac73c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:02.132909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5b7d6-59c0-411c-9d89-26a7f0cac73c service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:02.142097 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1352/2673] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:02.216962 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde047-ae88-4cc3-86d9-a41a81e39f20 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:02.226733 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde047-ae88-4cc3-86d9-a41a81e39f20 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:02.230342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a68b0-2221-4a65-92fb-82342224e956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:02.230967 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a68b0-2221-4a65-92fb-82342224e956 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:02.231247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a68b0-2221-4a65-92fb-82342224e956 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:02.231520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a68b0-2221-4a65-92fb-82342224e956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:02.286958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a68b0-2221-4a65-92fb-82342224e956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:02.288381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a68b0-2221-4a65-92fb-82342224e956 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:02.297275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1322/2674] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:09.360914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5b7d6-59c0-411c-9d89-26a7f0cac73c service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:09.425976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5b7d6-59c0-411c-9d89-26a7f0cac73c service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:09.430505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:09.431125 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:09.431409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:09.431679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] PATH_INFO: `/v3/users/a3c3370d55bd415992d369824a2877ac` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:09.433350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c3370d55bd415992d369824a2877ac)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:09.435257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:09.481631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c3370d55bd415992d369824a2877ac'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:09.493494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c3370d55bd415992d369824a2877ac'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:09.494168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c3370d55bd415992d369824a2877ac'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:09.503268 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c3370d55bd415992d369824a2877ac'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:09.503884 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c3370d55bd415992d369824a2877ac'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:09.517621 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1353/2675] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:09 2022] DELETE /identity/v3/users/a3c3370d55bd415992d369824a2877ac => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:07:09.522491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ab3e-eb1e-4126-994a-0a3c2125c05a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:09.522974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ab3e-eb1e-4126-994a-0a3c2125c05a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:09.523089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ab3e-eb1e-4126-994a-0a3c2125c05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:09.542587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8ab0ab3e-eb1e-4126-994a-0a3c2125c05a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:09.543842 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8ab0ab3e-eb1e-4126-994a-0a3c2125c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:09.611949 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1323/2676] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:09.622948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:09.624469 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:09.679550 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:09.695584 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96330a05-11e1-4a30-a4f5-a2ddb2b7f604 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:09.702663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475648fc-1e6c-46b0-9e19-07249dc26c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:09.703450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475648fc-1e6c-46b0-9e19-07249dc26c7b service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:09.703740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475648fc-1e6c-46b0-9e19-07249dc26c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:09.704017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475648fc-1e6c-46b0-9e19-07249dc26c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:09.715998 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475648fc-1e6c-46b0-9e19-07249dc26c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:09.717618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475648fc-1e6c-46b0-9e19-07249dc26c7b service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:09.730022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1354/2677] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:10.003315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0ab3e-eb1e-4126-994a-0a3c2125c05a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:10.004901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8ab0ab3e-eb1e-4126-994a-0a3c2125c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:10.017489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0ab3e-eb1e-4126-994a-0a3c2125c05a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:10.022756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:10.023425 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:10.023709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:10.023981 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] PATH_INFO: `/v3/projects/1e1502c400d9431bb984b3add09a7306` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:10.025150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1502c400d9431bb984b3add09a7306)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:10.027142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:10.034177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:10.082095 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1502c400d9431bb984b3add09a7306', 'request_id': 'req-49517573-c1ab-4bfc-aa0f-a48e38c5c979'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.087645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1502c400d9431bb984b3add09a7306', 'request_id': 'req-49517573-c1ab-4bfc-aa0f-a48e38c5c979'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.094432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1502c400d9431bb984b3add09a7306', 'request_id': 'req-49517573-c1ab-4bfc-aa0f-a48e38c5c979'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.107421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] The token cache is being invalidate because project 1e1502c400d9431bb984b3add09a7306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:10.107763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.108430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.110275 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1324/2678] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:10 2022] DELETE /identity/v3/projects/1e1502c400d9431bb984b3add09a7306 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:10.114005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475648fc-1e6c-46b0-9e19-07249dc26c7b service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:10.127876 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475648fc-1e6c-46b0-9e19-07249dc26c7b service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:10.186545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:10.187167 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:10.187442 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:10.187712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] PATH_INFO: `/v3/users/352bc0e40800425f956aa3ee8d6fb520` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:10.188809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352bc0e40800425f956aa3ee8d6fb520)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:10.190738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:10.235624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352bc0e40800425f956aa3ee8d6fb520'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.247619 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352bc0e40800425f956aa3ee8d6fb520'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.248293 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352bc0e40800425f956aa3ee8d6fb520'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.255655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352bc0e40800425f956aa3ee8d6fb520'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.256285 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0d465354-dbd6-4ad5-bf48-ea520f2760d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352bc0e40800425f956aa3ee8d6fb520'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.268234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1355/2679] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:10 2022] DELETE /identity/v3/users/352bc0e40800425f956aa3ee8d6fb520 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:10.540885 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:10.542902 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:10.565580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49517573-c1ab-4bfc-aa0f-a48e38c5c979 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:10.649242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:10.649242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:10.649242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:10.649242 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] PATH_INFO: `/v3/projects/6a5cec7d955f40f59648cd8ee55f5d23` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:10.650123 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5cec7d955f40f59648cd8ee55f5d23)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:10.651268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:10.700730 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5cec7d955f40f59648cd8ee55f5d23', 'request_id': 'req-965f5fab-abcf-44d5-96a9-e0cf135ee45e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.706716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5cec7d955f40f59648cd8ee55f5d23', 'request_id': 'req-965f5fab-abcf-44d5-96a9-e0cf135ee45e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.713309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5cec7d955f40f59648cd8ee55f5d23', 'request_id': 'req-965f5fab-abcf-44d5-96a9-e0cf135ee45e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.726033 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] The token cache is being invalidate because project 6a5cec7d955f40f59648cd8ee55f5d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:10.726322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.726933 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-965f5fab-abcf-44d5-96a9-e0cf135ee45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:10.728492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1325/2680] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:10 2022] DELETE /identity/v3/projects/6a5cec7d955f40f59648cd8ee55f5d23 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:10.734072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0e3ec-a0f6-488d-a3e3-3ec8c573eefb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:10.734558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0e3ec-a0f6-488d-a3e3-3ec8c573eefb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:10.734655 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0e3ec-a0f6-488d-a3e3-3ec8c573eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:10.753900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d3a0e3ec-a0f6-488d-a3e3-3ec8c573eefb None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:10.755332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d3a0e3ec-a0f6-488d-a3e3-3ec8c573eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:10.822164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1356/2681] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:10.831171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bba8a2-2a1c-409c-b812-7068d2c40e3a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:10.831495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bba8a2-2a1c-409c-b812-7068d2c40e3a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:10.831781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bba8a2-2a1c-409c-b812-7068d2c40e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:10.852002 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-28bba8a2-2a1c-409c-b812-7068d2c40e3a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:10.853252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-28bba8a2-2a1c-409c-b812-7068d2c40e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:10.861150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1326/2682] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:07:10.865385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0e3ec-a0f6-488d-a3e3-3ec8c573eefb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:10.871883 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:10.875774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0e3ec-a0f6-488d-a3e3-3ec8c573eefb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:10.881728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:10.882575 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:10.883085 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:10.883474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:10.884324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:07:10.884628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:10.886859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:10.898665 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1357/2683] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:07:10.902988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bba8a2-2a1c-409c-b812-7068d2c40e3a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:10.912708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bba8a2-2a1c-409c-b812-7068d2c40e3a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:10.917397 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3a74-ed47-4419-af7f-78a81ea88a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:10.917999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3a74-ed47-4419-af7f-78a81ea88a76 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:10.918282 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3a74-ed47-4419-af7f-78a81ea88a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:10.918556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3a74-ed47-4419-af7f-78a81ea88a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:10.919201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3a74-ed47-4419-af7f-78a81ea88a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:10.921120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3a74-ed47-4419-af7f-78a81ea88a76 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:10.940113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:10.954161 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1327/2684] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:10 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:07:10.958906 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:10.971180 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34bacd-5cc0-443f-9995-7742b38fbad8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.035544 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b2fc-f919-433b-be2f-d785c01709e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.036348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b2fc-f919-433b-be2f-d785c01709e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.036724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b2fc-f919-433b-be2f-d785c01709e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.037193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b2fc-f919-433b-be2f-d785c01709e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.037929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282b2fc-f919-433b-be2f-d785c01709e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.039957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282b2fc-f919-433b-be2f-d785c01709e2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.066536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1358/2685] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:10 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:11.069550 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3a74-ed47-4419-af7f-78a81ea88a76 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.082194 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3a74-ed47-4419-af7f-78a81ea88a76 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.087059 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11931d6e-efca-49f0-b176-daae300463c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.087671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11931d6e-efca-49f0-b176-daae300463c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.087955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11931d6e-efca-49f0-b176-daae300463c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.088230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11931d6e-efca-49f0-b176-daae300463c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.088901 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11931d6e-efca-49f0-b176-daae300463c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.090531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11931d6e-efca-49f0-b176-daae300463c1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.102052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1328/2686] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:11.106049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b2fc-f919-433b-be2f-d785c01709e2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.116218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b2fc-f919-433b-be2f-d785c01709e2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.121770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0afb1c-e4c6-4bbf-a85a-7931182de257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.122570 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0afb1c-e4c6-4bbf-a85a-7931182de257 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.123057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0afb1c-e4c6-4bbf-a85a-7931182de257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.123702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0afb1c-e4c6-4bbf-a85a-7931182de257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.124122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0afb1c-e4c6-4bbf-a85a-7931182de257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.125812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0afb1c-e4c6-4bbf-a85a-7931182de257 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.138210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1359/2687] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:11.142201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11931d6e-efca-49f0-b176-daae300463c1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.153014 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11931d6e-efca-49f0-b176-daae300463c1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.161371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46597c74-d6a4-418f-81e5-8990ec0c24c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.165166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46597c74-d6a4-418f-81e5-8990ec0c24c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.165166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46597c74-d6a4-418f-81e5-8990ec0c24c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.165166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46597c74-d6a4-418f-81e5-8990ec0c24c0 admin admin] PATH_INFO: `/v3/projects/34a6b509959c47eeb12cad830fbf4ef4/users/badb9f0f76b641bba6b82ceb19610979/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.180539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46597c74-d6a4-418f-81e5-8990ec0c24c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a6b509959c47eeb12cad830fbf4ef4, user_id=badb9f0f76b641bba6b82ceb19610979, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.184454 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46597c74-d6a4-418f-81e5-8990ec0c24c0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.201216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1329/2688] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:11 2022] PUT /identity/v3/projects/34a6b509959c47eeb12cad830fbf4ef4/users/badb9f0f76b641bba6b82ceb19610979/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:11.214332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603f7e-3277-4b3d-a9dd-74ff70382cb3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.214635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603f7e-3277-4b3d-a9dd-74ff70382cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.214905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603f7e-3277-4b3d-a9dd-74ff70382cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.251982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cf603f7e-3277-4b3d-a9dd-74ff70382cb3 None None] MFA Rules not processed for user `badb9f0f76b641bba6b82ceb19610979`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:11.253233 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf603f7e-3277-4b3d-a9dd-74ff70382cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:11.321462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1360/2689] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:07:11.326763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46597c74-d6a4-418f-81e5-8990ec0c24c0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.390720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46597c74-d6a4-418f-81e5-8990ec0c24c0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.395414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b1bd-0671-4684-af6e-aa006d4bfe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.396016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b1bd-0671-4684-af6e-aa006d4bfe0f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.396297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b1bd-0671-4684-af6e-aa006d4bfe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.396569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393b1bd-0671-4684-af6e-aa006d4bfe0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.397231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393b1bd-0671-4684-af6e-aa006d4bfe0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.399110 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393b1bd-0671-4684-af6e-aa006d4bfe0f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.430072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1330/2690] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:11 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:11.431146 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603f7e-3277-4b3d-a9dd-74ff70382cb3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.442203 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603f7e-3277-4b3d-a9dd-74ff70382cb3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.511052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac6e5-77b5-4c7c-82b2-4bbcde046a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.511684 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac6e5-77b5-4c7c-82b2-4bbcde046a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.512077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac6e5-77b5-4c7c-82b2-4bbcde046a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.512357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac6e5-77b5-4c7c-82b2-4bbcde046a8c admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.513132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ac6e5-77b5-4c7c-82b2-4bbcde046a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.515056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ac6e5-77b5-4c7c-82b2-4bbcde046a8c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.523370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:11.540674 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1361/2691] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:11 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:07:11.544570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b1bd-0671-4684-af6e-aa006d4bfe0f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.556000 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393b1bd-0671-4684-af6e-aa006d4bfe0f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.562126 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b59df0-d3a4-4963-86a4-f4b6aabb072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.563023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b59df0-d3a4-4963-86a4-f4b6aabb072a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.563544 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b59df0-d3a4-4963-86a4-f4b6aabb072a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.563761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b59df0-d3a4-4963-86a4-f4b6aabb072a admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.564944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b59df0-d3a4-4963-86a4-f4b6aabb072a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.566606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b59df0-d3a4-4963-86a4-f4b6aabb072a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.582516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1331/2692] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:11.586591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac6e5-77b5-4c7c-82b2-4bbcde046a8c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.599041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac6e5-77b5-4c7c-82b2-4bbcde046a8c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.604050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52de4-1177-4117-b492-2fc391930b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.604870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52de4-1177-4117-b492-2fc391930b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.605188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52de4-1177-4117-b492-2fc391930b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.605468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b52de4-1177-4117-b492-2fc391930b88 admin admin] PATH_INFO: `/v3/projects/fbd8ae80dc2d41b683bc5bde3bcaee31/users/f80de1b4409b43c78f82657e04ccb311/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.624675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b52de4-1177-4117-b492-2fc391930b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd8ae80dc2d41b683bc5bde3bcaee31, user_id=f80de1b4409b43c78f82657e04ccb311, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.627729 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b52de4-1177-4117-b492-2fc391930b88 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.650205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1362/2693] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:11 2022] PUT /identity/v3/projects/fbd8ae80dc2d41b683bc5bde3bcaee31/users/f80de1b4409b43c78f82657e04ccb311/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:07:11.651542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b59df0-d3a4-4963-86a4-f4b6aabb072a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.662825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b59df0-d3a4-4963-86a4-f4b6aabb072a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.738626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320472a3-3fcb-4d8f-9ce4-2385f2db82ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.739300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320472a3-3fcb-4d8f-9ce4-2385f2db82ab admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.739599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320472a3-3fcb-4d8f-9ce4-2385f2db82ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.739883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320472a3-3fcb-4d8f-9ce4-2385f2db82ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.740821 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320472a3-3fcb-4d8f-9ce4-2385f2db82ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.742204 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320472a3-3fcb-4d8f-9ce4-2385f2db82ab admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.758458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1332/2694] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:11.762396 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52de4-1177-4117-b492-2fc391930b88 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.777855 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b52de4-1177-4117-b492-2fc391930b88 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:11.790787 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:11.792109 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.792476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.793175 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] PATH_INFO: `/v3/projects/fbd8ae80dc2d41b683bc5bde3bcaee31/users/f80de1b4409b43c78f82657e04ccb311/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.795358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd8ae80dc2d41b683bc5bde3bcaee31, user_id=f80de1b4409b43c78f82657e04ccb311, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:11.798334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:11.823854 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1363/2695] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:11 2022] PUT /identity/v3/projects/fbd8ae80dc2d41b683bc5bde3bcaee31/users/f80de1b4409b43c78f82657e04ccb311/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:11.834581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc66cd-fdd7-4767-a282-f021c94c9eee None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:11.834850 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc66cd-fdd7-4767-a282-f021c94c9eee None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:11.835729 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc66cd-fdd7-4767-a282-f021c94c9eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:11.874016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c6fc66cd-fdd7-4767-a282-f021c94c9eee None None] MFA Rules not processed for user `f80de1b4409b43c78f82657e04ccb311`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:11.875823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c6fc66cd-fdd7-4767-a282-f021c94c9eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:11.904575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:11.963032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1333/2696] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:11.971463 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:11.973250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:12.038136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79a393-6322-484b-95f9-f6852ccc2a7d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:12.041823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:12.042453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:12.042717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:12.042992 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:12.052205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:12.053696 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:12.063286 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1364/2697] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:11 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:12.111009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc66cd-fdd7-4767-a282-f021c94c9eee None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:12.112405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c6fc66cd-fdd7-4767-a282-f021c94c9eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:12.126178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc66cd-fdd7-4767-a282-f021c94c9eee None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:12.129906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecd289-e71d-4589-b3a3-8f9aacd62126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:12.130511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd289-e71d-4589-b3a3-8f9aacd62126 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:12.130813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd289-e71d-4589-b3a3-8f9aacd62126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:12.131090 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecd289-e71d-4589-b3a3-8f9aacd62126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:12.188523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecd289-e71d-4589-b3a3-8f9aacd62126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:12.189975 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecd289-e71d-4589-b3a3-8f9aacd62126 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:12.199305 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1334/2698] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:13.712555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:13.714786 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:13.822068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbcb6b-bfa8-4731-a931-a9bc7eded277 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:13.831094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c359a9-e975-407d-8bf2-ae6480a6c033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:13.831988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c359a9-e975-407d-8bf2-ae6480a6c033 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:13.832340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c359a9-e975-407d-8bf2-ae6480a6c033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:13.832680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c359a9-e975-407d-8bf2-ae6480a6c033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:13.838068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d2c359a9-e975-407d-8bf2-ae6480a6c033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:13.953370 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c359a9-e975-407d-8bf2-ae6480a6c033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:13.954953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c359a9-e975-407d-8bf2-ae6480a6c033 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:13.966313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1365/2699] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:15.745959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecd289-e71d-4589-b3a3-8f9aacd62126 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:15.757540 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecd289-e71d-4589-b3a3-8f9aacd62126 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:15.762681 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:15.763314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:15.763595 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:15.763871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] PATH_INFO: `/v3/users/badb9f0f76b641bba6b82ceb19610979` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:15.765018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=badb9f0f76b641bba6b82ceb19610979)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:15.767050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:15.818302 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'badb9f0f76b641bba6b82ceb19610979'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:15.832067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'badb9f0f76b641bba6b82ceb19610979'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:15.832772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'badb9f0f76b641bba6b82ceb19610979'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:15.840290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'badb9f0f76b641bba6b82ceb19610979'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:15.841068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'badb9f0f76b641bba6b82ceb19610979'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:15.853700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1335/2700] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:15 2022] DELETE /identity/v3/users/badb9f0f76b641bba6b82ceb19610979 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:15.859850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22522146-93a3-428d-b064-2fabd2b82371 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:15.860355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22522146-93a3-428d-b064-2fabd2b82371 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:15.860457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22522146-93a3-428d-b064-2fabd2b82371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:15.869008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:15.880444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-22522146-93a3-428d-b064-2fabd2b82371 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:15.881677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-22522146-93a3-428d-b064-2fabd2b82371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:15.957024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1366/2701] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:15.994657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:15.996430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:16.064995 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:16.103964 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e092bf-6ebe-43ca-a151-d5a5f2e12147 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:16.109050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb1425-a07d-49d5-9600-63c9e6899271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:16.109670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1425-a07d-49d5-9600-63c9e6899271 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:16.109946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1425-a07d-49d5-9600-63c9e6899271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:16.110216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb1425-a07d-49d5-9600-63c9e6899271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:16.122112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb1425-a07d-49d5-9600-63c9e6899271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:16.123559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bb1425-a07d-49d5-9600-63c9e6899271 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:16.135462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1336/2702] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:16.672194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22522146-93a3-428d-b064-2fabd2b82371 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:16.673764 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-22522146-93a3-428d-b064-2fabd2b82371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:16.690975 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22522146-93a3-428d-b064-2fabd2b82371 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:16.701967 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:16.702870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:16.703156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:16.703433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] PATH_INFO: `/v3/projects/34a6b509959c47eeb12cad830fbf4ef4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:16.704706 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a6b509959c47eeb12cad830fbf4ef4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:16.707102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:16.776934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a6b509959c47eeb12cad830fbf4ef4', 'request_id': 'req-4f913aae-4bfa-416d-8587-bedf527a7574'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:16.784831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a6b509959c47eeb12cad830fbf4ef4', 'request_id': 'req-4f913aae-4bfa-416d-8587-bedf527a7574'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:16.793712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a6b509959c47eeb12cad830fbf4ef4', 'request_id': 'req-4f913aae-4bfa-416d-8587-bedf527a7574'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:16.823714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] The token cache is being invalidate because project 34a6b509959c47eeb12cad830fbf4ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:16.824001 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:16.824678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:16.826224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1367/2703] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:16 2022] DELETE /identity/v3/projects/34a6b509959c47eeb12cad830fbf4ef4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:16.830781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb1425-a07d-49d5-9600-63c9e6899271 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:16.849917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb1425-a07d-49d5-9600-63c9e6899271 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:16.937582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:16.938231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:16.938513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:16.938782 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] PATH_INFO: `/v3/users/f80de1b4409b43c78f82657e04ccb311` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:16.939935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80de1b4409b43c78f82657e04ccb311)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:16.942035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:16.994808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80de1b4409b43c78f82657e04ccb311'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.007604 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80de1b4409b43c78f82657e04ccb311'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.008335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80de1b4409b43c78f82657e04ccb311'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.017897 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80de1b4409b43c78f82657e04ccb311'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.018577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ee7890d6-e191-4762-b101-da109c257ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80de1b4409b43c78f82657e04ccb311'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.032315 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1337/2704] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:16 2022] DELETE /identity/v3/users/f80de1b4409b43c78f82657e04ccb311 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:17.335086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:17.336659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:17.372260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f913aae-4bfa-416d-8587-bedf527a7574 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:17.440728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:17.441423 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:17.441704 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:17.442056 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] PATH_INFO: `/v3/projects/fbd8ae80dc2d41b683bc5bde3bcaee31` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:17.443337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd8ae80dc2d41b683bc5bde3bcaee31)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:17.445360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:17.498744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:17.546112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd8ae80dc2d41b683bc5bde3bcaee31', 'request_id': 'req-1fa44bfb-c7ca-426b-95a7-75f62df60f96'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.553983 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd8ae80dc2d41b683bc5bde3bcaee31', 'request_id': 'req-1fa44bfb-c7ca-426b-95a7-75f62df60f96'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.564071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd8ae80dc2d41b683bc5bde3bcaee31', 'request_id': 'req-1fa44bfb-c7ca-426b-95a7-75f62df60f96'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.579713 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] The token cache is being invalidate because project fbd8ae80dc2d41b683bc5bde3bcaee31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:17.580273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.581351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1fa44bfb-c7ca-426b-95a7-75f62df60f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:17.583437 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1368/2705] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:17 2022] DELETE /identity/v3/projects/fbd8ae80dc2d41b683bc5bde3bcaee31 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:17.591581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2cab8-f546-4972-984b-5f53a0bc74fd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:17.591581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2cab8-f546-4972-984b-5f53a0bc74fd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:17.591581 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2cab8-f546-4972-984b-5f53a0bc74fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:17.611840 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-efd2cab8-f546-4972-984b-5f53a0bc74fd None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:17.613254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-efd2cab8-f546-4972-984b-5f53a0bc74fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:17.676049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:17.696245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1338/2706] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:17.704829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017142ab-595d-442a-8251-762cd322f8de None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:17.705315 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017142ab-595d-442a-8251-762cd322f8de None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:17.706005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017142ab-595d-442a-8251-762cd322f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:17.731460 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-017142ab-595d-442a-8251-762cd322f8de None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:17.732588 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-017142ab-595d-442a-8251-762cd322f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:17.740471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1369/2707] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:17.744831 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2cab8-f546-4972-984b-5f53a0bc74fd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:17.755466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2cab8-f546-4972-984b-5f53a0bc74fd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:17.763217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:17.763420 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:17.763543 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:17.763911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:17.764634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:07:17.765029 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:17.766763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:17.780355 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1339/2708] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:07:17.785190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017142ab-595d-442a-8251-762cd322f8de None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:17.795535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017142ab-595d-442a-8251-762cd322f8de None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:17.800382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5fda6-c6d4-409f-86b8-7821642b035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:17.801435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5fda6-c6d4-409f-86b8-7821642b035b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:17.801435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5fda6-c6d4-409f-86b8-7821642b035b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:17.801627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5fda6-c6d4-409f-86b8-7821642b035b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:17.802197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5fda6-c6d4-409f-86b8-7821642b035b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:17.804103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5fda6-c6d4-409f-86b8-7821642b035b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:17.834873 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1370/2709] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:17 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:17.839869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:17.851518 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575f770-ffda-4b96-9092-e9296d4d5d49 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:17.926657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7da452-871a-4326-96da-65229124384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:17.927273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7da452-871a-4326-96da-65229124384e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:17.927552 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7da452-871a-4326-96da-65229124384e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:17.927823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7da452-871a-4326-96da-65229124384e admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:17.928452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7da452-871a-4326-96da-65229124384e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:17.930811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7da452-871a-4326-96da-65229124384e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:17.958547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1340/2710] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:17 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:17.962807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5fda6-c6d4-409f-86b8-7821642b035b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:17.974193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5fda6-c6d4-409f-86b8-7821642b035b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:17.979130 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2500ab-cd94-4681-81b0-28976ea1535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:17.979840 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2500ab-cd94-4681-81b0-28976ea1535a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:17.980236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2500ab-cd94-4681-81b0-28976ea1535a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:17.980613 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2500ab-cd94-4681-81b0-28976ea1535a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:17.981429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2500ab-cd94-4681-81b0-28976ea1535a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:17.983372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2500ab-cd94-4681-81b0-28976ea1535a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:17.998669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1371/2711] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:18.000081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7da452-871a-4326-96da-65229124384e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.011794 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7da452-871a-4326-96da-65229124384e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.023083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333054b8-06c5-4941-9f76-228a657ab3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.023999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333054b8-06c5-4941-9f76-228a657ab3be admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.024421 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333054b8-06c5-4941-9f76-228a657ab3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.026109 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333054b8-06c5-4941-9f76-228a657ab3be admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.027015 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333054b8-06c5-4941-9f76-228a657ab3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.028847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333054b8-06c5-4941-9f76-228a657ab3be admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.040200 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1341/2712] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:18.044926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2500ab-cd94-4681-81b0-28976ea1535a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.055600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2500ab-cd94-4681-81b0-28976ea1535a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.061246 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84d23-92b3-4e8a-878c-526462d42dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.061905 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84d23-92b3-4e8a-878c-526462d42dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.062183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84d23-92b3-4e8a-878c-526462d42dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.062459 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84d23-92b3-4e8a-878c-526462d42dfc admin admin] PATH_INFO: `/v3/projects/602c0bb42e3f4f80a36044b3698aa512/users/e82b671d2f6043879063efee59c65e98/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.079106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae84d23-92b3-4e8a-878c-526462d42dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=602c0bb42e3f4f80a36044b3698aa512, user_id=e82b671d2f6043879063efee59c65e98, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.082478 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae84d23-92b3-4e8a-878c-526462d42dfc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.096181 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1372/2713] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:18 2022] PUT /identity/v3/projects/602c0bb42e3f4f80a36044b3698aa512/users/e82b671d2f6043879063efee59c65e98/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:18.107704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d32a-15b9-47ad-b510-37650ad6ccab None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.107990 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d32a-15b9-47ad-b510-37650ad6ccab None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.108260 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8d32a-15b9-47ad-b510-37650ad6ccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.137541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-aef8d32a-15b9-47ad-b510-37650ad6ccab None None] MFA Rules not processed for user `e82b671d2f6043879063efee59c65e98`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:18.138834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aef8d32a-15b9-47ad-b510-37650ad6ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:18.212116 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1342/2714] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:18.217064 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84d23-92b3-4e8a-878c-526462d42dfc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.217403 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d32a-15b9-47ad-b510-37650ad6ccab None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.218827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aef8d32a-15b9-47ad-b510-37650ad6ccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:18.270780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:18.292743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8d32a-15b9-47ad-b510-37650ad6ccab None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.297788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.298452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.298732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.299003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] PATH_INFO: `/v3/users/899c4dc4a6264142bcc22acbbe9b12d9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.300199 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899c4dc4a6264142bcc22acbbe9b12d9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.302201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.354568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899c4dc4a6264142bcc22acbbe9b12d9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.366790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899c4dc4a6264142bcc22acbbe9b12d9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.367527 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899c4dc4a6264142bcc22acbbe9b12d9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.377776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899c4dc4a6264142bcc22acbbe9b12d9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.378489 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899c4dc4a6264142bcc22acbbe9b12d9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.391639 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1343/2715] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:18 2022] DELETE /identity/v3/users/899c4dc4a6264142bcc22acbbe9b12d9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:18.404484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84d23-92b3-4e8a-878c-526462d42dfc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.461038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.461652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.461934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.462208 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.462851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.465340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.470605 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:18.494858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1373/2716] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:18 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:07:18.499880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.501447 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:18.514727 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceba54-64ff-416b-9808-23803ff5f415 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.566870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.569022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:18.579916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce4b6-d9db-457d-ba1e-0cc622fde560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.581096 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce4b6-d9db-457d-ba1e-0cc622fde560 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.581551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce4b6-d9db-457d-ba1e-0cc622fde560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.581948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce4b6-d9db-457d-ba1e-0cc622fde560 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.582615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce4b6-d9db-457d-ba1e-0cc622fde560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.584596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce4b6-d9db-457d-ba1e-0cc622fde560 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.611972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1344/2717] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:18 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:18.613052 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce4b6-d9db-457d-ba1e-0cc622fde560 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.623321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce4b6-d9db-457d-ba1e-0cc622fde560 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.628570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34e92a-70a9-4a4a-a105-f498ba1f479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.629281 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34e92a-70a9-4a4a-a105-f498ba1f479a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.629567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34e92a-70a9-4a4a-a105-f498ba1f479a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.629843 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34e92a-70a9-4a4a-a105-f498ba1f479a admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.630511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34e92a-70a9-4a4a-a105-f498ba1f479a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.632270 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34e92a-70a9-4a4a-a105-f498ba1f479a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.645781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1345/2718] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:18.646778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34e92a-70a9-4a4a-a105-f498ba1f479a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.654631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1202a-664f-41d6-8105-abe7775a99d4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.657063 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34e92a-70a9-4a4a-a105-f498ba1f479a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.659192 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.659813 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.660089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.660357 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] PATH_INFO: `/v3/projects/8e205554b118462698819aaa02d172d9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.661489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e205554b118462698819aaa02d172d9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.661709 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b56d6-b535-465a-a0d1-920042cf5c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.662345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b56d6-b535-465a-a0d1-920042cf5c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.662626 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b56d6-b535-465a-a0d1-920042cf5c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.662898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b56d6-b535-465a-a0d1-920042cf5c72 admin admin] PATH_INFO: `/v3/projects/790ec8678a474d78b56cdf5f708eff76/users/6a3b9918b1a348c095a0c38e677554e3/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.663398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.678914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b56d6-b535-465a-a0d1-920042cf5c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790ec8678a474d78b56cdf5f708eff76, user_id=6a3b9918b1a348c095a0c38e677554e3, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.681837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b56d6-b535-465a-a0d1-920042cf5c72 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.708573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1346/2719] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:18 2022] PUT /identity/v3/projects/790ec8678a474d78b56cdf5f708eff76/users/6a3b9918b1a348c095a0c38e677554e3/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:18.713956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b56d6-b535-465a-a0d1-920042cf5c72 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.730363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e205554b118462698819aaa02d172d9', 'request_id': 'req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.736707 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:18.739648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e205554b118462698819aaa02d172d9', 'request_id': 'req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.747522 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e205554b118462698819aaa02d172d9', 'request_id': 'req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.762910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] The token cache is being invalidate because project 8e205554b118462698819aaa02d172d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:18.763276 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.763865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.765589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1374/2720] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:18 2022] DELETE /identity/v3/projects/8e205554b118462698819aaa02d172d9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:07:18.769241 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.770650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:18.796490 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b56d6-b535-465a-a0d1-920042cf5c72 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.846887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ba7cb-d0db-4929-a19e-e97201ea5c71 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.852005 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.852659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.852936 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.853256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] PATH_INFO: `/v3/users/391457eb45a646678d4ef035603fb00d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.854400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391457eb45a646678d4ef035603fb00d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.855710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.856358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.856466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.856705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.857004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.857657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.859237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.869336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1347/2721] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:07:18.873304 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:18.874996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:18.877446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:18.891238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac060d-912c-4d64-9458-5a7f7f7f58f0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:18.897157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a57c1f-73e7-4d09-993b-b9efb1873dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:18.898146 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57c1f-73e7-4d09-993b-b9efb1873dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.898498 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57c1f-73e7-4d09-993b-b9efb1873dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.898836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a57c1f-73e7-4d09-993b-b9efb1873dca admin admin] PATH_INFO: `/v3/projects/790ec8678a474d78b56cdf5f708eff76/users/6a3b9918b1a348c095a0c38e677554e3/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.900818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a57c1f-73e7-4d09-993b-b9efb1873dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=790ec8678a474d78b56cdf5f708eff76, user_id=6a3b9918b1a348c095a0c38e677554e3, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:18.904164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a57c1f-73e7-4d09-993b-b9efb1873dca admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:18.910626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391457eb45a646678d4ef035603fb00d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.915890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1348/2722] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:18 2022] PUT /identity/v3/projects/790ec8678a474d78b56cdf5f708eff76/users/6a3b9918b1a348c095a0c38e677554e3/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:07:18.924336 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391457eb45a646678d4ef035603fb00d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.925247 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391457eb45a646678d4ef035603fb00d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.926225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef35e2-b09d-4184-8977-24fcb0b6173a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:18.926559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef35e2-b09d-4184-8977-24fcb0b6173a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:18.926904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef35e2-b09d-4184-8977-24fcb0b6173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:18.934166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391457eb45a646678d4ef035603fb00d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.934991 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391457eb45a646678d4ef035603fb00d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:18.949624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1375/2723] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:18 2022] DELETE /identity/v3/users/391457eb45a646678d4ef035603fb00d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:07:18.962676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-68ef35e2-b09d-4184-8977-24fcb0b6173a None None] MFA Rules not processed for user `6a3b9918b1a348c095a0c38e677554e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:18.964216 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-68ef35e2-b09d-4184-8977-24fcb0b6173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:19.045656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1349/2724] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:07:19.058252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:19.060204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:19.126318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224856b-92a8-4e89-a075-838df2101693 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:19.126646 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef35e2-b09d-4184-8977-24fcb0b6173a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:19.128139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-68ef35e2-b09d-4184-8977-24fcb0b6173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:19.129937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:19.130541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:19.130819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:19.131245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:19.133670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:19.167795 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:19.199224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:19.200613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef35e2-b09d-4184-8977-24fcb0b6173a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:19.200851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:19.205442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:19.206323 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:19.206759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:19.207043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] PATH_INFO: `/v3/projects/188280fb01044e2faa134c974bb8b1d5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:19.208257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188280fb01044e2faa134c974bb8b1d5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:19.210141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:19.211034 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1376/2725] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:19.257684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188280fb01044e2faa134c974bb8b1d5', 'request_id': 'req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:19.263542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188280fb01044e2faa134c974bb8b1d5', 'request_id': 'req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:19.270290 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188280fb01044e2faa134c974bb8b1d5', 'request_id': 'req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:19.285748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] The token cache is being invalidate because project 188280fb01044e2faa134c974bb8b1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:19.286046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:19.286689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:19.288221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1350/2726] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:19 2022] DELETE /identity/v3/projects/188280fb01044e2faa134c974bb8b1d5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:07:23.599427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:23.600807 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:23.612602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69be3-7b4f-437f-90c4-dbde4af414b4 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:23.661598 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae53e7-ba9a-4ce6-b348-98f135ed8376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:23.662211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae53e7-ba9a-4ce6-b348-98f135ed8376 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:23.662511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae53e7-ba9a-4ce6-b348-98f135ed8376 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:23.662763 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae53e7-ba9a-4ce6-b348-98f135ed8376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:23.664480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a3ae53e7-ba9a-4ce6-b348-98f135ed8376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:23.669993 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:23.729104 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae53e7-ba9a-4ce6-b348-98f135ed8376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:23.731091 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae53e7-ba9a-4ce6-b348-98f135ed8376 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:23.740599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1377/2727] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:28.674866 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:28.676259 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:28.740030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ec56a-eeb8-4532-b3ca-1c38c3474c96 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:28.744559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:28.745205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:28.745484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:28.745754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] PATH_INFO: `/v3/users/e82b671d2f6043879063efee59c65e98` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:28.746989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82b671d2f6043879063efee59c65e98)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:28.748877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:28.793969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82b671d2f6043879063efee59c65e98'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:28.807625 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82b671d2f6043879063efee59c65e98'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:28.808329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82b671d2f6043879063efee59c65e98'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:28.813148 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:28.815942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82b671d2f6043879063efee59c65e98'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:28.816685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82b671d2f6043879063efee59c65e98'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:28.830845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1351/2728] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:28 2022] DELETE /identity/v3/users/e82b671d2f6043879063efee59c65e98 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:28.835971 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84355-24aa-4df1-a5a9-c8481983544a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:28.836406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84355-24aa-4df1-a5a9-c8481983544a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:28.836548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84355-24aa-4df1-a5a9-c8481983544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:28.855479 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5ff84355-24aa-4df1-a5a9-c8481983544a None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:28.856659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5ff84355-24aa-4df1-a5a9-c8481983544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:28.912965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1378/2729] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:28.922624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:28.924004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:28.980120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f236c9-6b3a-4f78-a204-fd463e6a8f84 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:28.983808 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb0ff-aab8-42d6-9c6d-fc354f19aac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:28.984398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb0ff-aab8-42d6-9c6d-fc354f19aac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:28.984675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb0ff-aab8-42d6-9c6d-fc354f19aac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:28.984943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cb0ff-aab8-42d6-9c6d-fc354f19aac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:28.993763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb0ff-aab8-42d6-9c6d-fc354f19aac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:28.995166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cb0ff-aab8-42d6-9c6d-fc354f19aac5 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:29.004847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1352/2730] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:29.273587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84355-24aa-4df1-a5a9-c8481983544a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:29.275002 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5ff84355-24aa-4df1-a5a9-c8481983544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:29.287258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84355-24aa-4df1-a5a9-c8481983544a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:29.291774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:29.292405 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:29.292686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:29.292953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] PATH_INFO: `/v3/projects/602c0bb42e3f4f80a36044b3698aa512` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:29.294102 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=602c0bb42e3f4f80a36044b3698aa512)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:29.296429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:29.342341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602c0bb42e3f4f80a36044b3698aa512', 'request_id': 'req-afba022b-fca4-4080-8990-bfdd16a5aa0b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.347754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602c0bb42e3f4f80a36044b3698aa512', 'request_id': 'req-afba022b-fca4-4080-8990-bfdd16a5aa0b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.353778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602c0bb42e3f4f80a36044b3698aa512', 'request_id': 'req-afba022b-fca4-4080-8990-bfdd16a5aa0b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.365506 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] The token cache is being invalidate because project 602c0bb42e3f4f80a36044b3698aa512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:29.365795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.366412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.367886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1379/2731] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:29 2022] DELETE /identity/v3/projects/602c0bb42e3f4f80a36044b3698aa512 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:29.371932 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb0ff-aab8-42d6-9c6d-fc354f19aac5 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:29.381524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cb0ff-aab8-42d6-9c6d-fc354f19aac5 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:29.436237 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:29.436871 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:29.437208 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:29.437474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] PATH_INFO: `/v3/users/6a3b9918b1a348c095a0c38e677554e3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:29.438578 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a3b9918b1a348c095a0c38e677554e3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:29.440473 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:29.485325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a3b9918b1a348c095a0c38e677554e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.497011 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a3b9918b1a348c095a0c38e677554e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.497667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a3b9918b1a348c095a0c38e677554e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.504725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a3b9918b1a348c095a0c38e677554e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.505361 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8952c15e-f774-4821-8a7a-cb62018318dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a3b9918b1a348c095a0c38e677554e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.517743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1353/2732] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:29 2022] DELETE /identity/v3/users/6a3b9918b1a348c095a0c38e677554e3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:29.787727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:29.789406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:29.802708 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba022b-fca4-4080-8990-bfdd16a5aa0b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:29.829931 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:29.867494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:29.868121 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:29.868394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:29.868672 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] PATH_INFO: `/v3/projects/790ec8678a474d78b56cdf5f708eff76` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:29.871148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790ec8678a474d78b56cdf5f708eff76)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:29.871762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:29.916735 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790ec8678a474d78b56cdf5f708eff76', 'request_id': 'req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.922791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790ec8678a474d78b56cdf5f708eff76', 'request_id': 'req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.928666 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790ec8678a474d78b56cdf5f708eff76', 'request_id': 'req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.941081 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] The token cache is being invalidate because project 790ec8678a474d78b56cdf5f708eff76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:29.941359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.941972 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3fa7b2ef-8e96-49e7-ac33-0b823be40fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:29.943427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1380/2733] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:29 2022] DELETE /identity/v3/projects/790ec8678a474d78b56cdf5f708eff76 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:29.949720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d775-f818-4d11-99cd-0c1408ae1891 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:29.950210 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d775-f818-4d11-99cd-0c1408ae1891 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:29.950310 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d775-f818-4d11-99cd-0c1408ae1891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:29.958928 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:29.971100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6de9d775-f818-4d11-99cd-0c1408ae1891 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:29.972533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6de9d775-f818-4d11-99cd-0c1408ae1891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:30.028989 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1354/2734] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:30.038259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf36925-6790-49b3-8394-7547bbad5ac0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.038485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf36925-6790-49b3-8394-7547bbad5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.038793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf36925-6790-49b3-8394-7547bbad5ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.058703 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7cf36925-6790-49b3-8394-7547bbad5ac0 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:30.060021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7cf36925-6790-49b3-8394-7547bbad5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:30.067826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1381/2735] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:30.072050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9d775-f818-4d11-99cd-0c1408ae1891 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:30.082658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9d775-f818-4d11-99cd-0c1408ae1891 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:30.087327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:30.087925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.088206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.088478 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.089167 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:07:30.089471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:30.091106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:30.102401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1355/2736] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:07:30.107278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf36925-6790-49b3-8394-7547bbad5ac0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:30.116211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf36925-6790-49b3-8394-7547bbad5ac0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:30.120769 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8f240-0f04-459a-b44c-fef1ff76615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:30.121973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8f240-0f04-459a-b44c-fef1ff76615d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.122270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8f240-0f04-459a-b44c-fef1ff76615d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.122538 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8f240-0f04-459a-b44c-fef1ff76615d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.123163 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8f240-0f04-459a-b44c-fef1ff76615d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:30.125253 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb8f240-0f04-459a-b44c-fef1ff76615d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:30.151314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1382/2737] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:30 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:30.155446 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:30.165201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aba369-5af9-477b-b39e-4a6af2076b51 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:30.222035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1261d-98b8-4128-ab0f-d35323934146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:30.222637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1261d-98b8-4128-ab0f-d35323934146 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.222911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1261d-98b8-4128-ab0f-d35323934146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.223178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1261d-98b8-4128-ab0f-d35323934146 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.223807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1261d-98b8-4128-ab0f-d35323934146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:30.225714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1261d-98b8-4128-ab0f-d35323934146 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:30.246867 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1356/2738] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:30 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:07:30.251089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8f240-0f04-459a-b44c-fef1ff76615d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:30.261134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8f240-0f04-459a-b44c-fef1ff76615d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:30.266189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678905fa-c282-4bda-8b1f-5acf99e04472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:30.266781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678905fa-c282-4bda-8b1f-5acf99e04472 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.267059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678905fa-c282-4bda-8b1f-5acf99e04472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.267331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678905fa-c282-4bda-8b1f-5acf99e04472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.267961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678905fa-c282-4bda-8b1f-5acf99e04472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:30.269590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678905fa-c282-4bda-8b1f-5acf99e04472 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:30.279382 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1383/2739] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:30.283213 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1261d-98b8-4128-ab0f-d35323934146 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:30.293588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1261d-98b8-4128-ab0f-d35323934146 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:30.298117 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152adce-0626-408e-9e68-2eb5961e9df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:30.298710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152adce-0626-408e-9e68-2eb5961e9df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.298996 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152adce-0626-408e-9e68-2eb5961e9df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.299271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152adce-0626-408e-9e68-2eb5961e9df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.299906 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152adce-0626-408e-9e68-2eb5961e9df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:30.301503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152adce-0626-408e-9e68-2eb5961e9df5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:30.311190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1357/2740] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:30.315156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678905fa-c282-4bda-8b1f-5acf99e04472 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:30.325361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678905fa-c282-4bda-8b1f-5acf99e04472 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:30.329917 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:30.330566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.330844 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.331116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] PATH_INFO: `/v3/projects/681381addb714654a47f129c82be66dc/users/394c05f2987f4ff7aca0f8fbcc3ba54a/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.347833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=681381addb714654a47f129c82be66dc, user_id=394c05f2987f4ff7aca0f8fbcc3ba54a, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:30.350608 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:30.363227 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1384/2741] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:30 2022] PUT /identity/v3/projects/681381addb714654a47f129c82be66dc/users/394c05f2987f4ff7aca0f8fbcc3ba54a/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:30.375826 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8da18-7a10-4a18-b3bc-745d41af08a0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.376217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8da18-7a10-4a18-b3bc-745d41af08a0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.376495 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8da18-7a10-4a18-b3bc-745d41af08a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.405217 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-18d8da18-7a10-4a18-b3bc-745d41af08a0 None None] MFA Rules not processed for user `394c05f2987f4ff7aca0f8fbcc3ba54a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:30.406413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-18d8da18-7a10-4a18-b3bc-745d41af08a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:30.466378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:30.470555 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1358/2742] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:30.481291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:30.482958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:30.537894 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb04910-1e64-4a90-8f7f-d2bb24e44fdb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:30.541501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54697c-bf06-4a71-8919-758446010ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:30.542100 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54697c-bf06-4a71-8919-758446010ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:30.542376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54697c-bf06-4a71-8919-758446010ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:30.542648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54697c-bf06-4a71-8919-758446010ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:30.547738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:30.552244 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54697c-bf06-4a71-8919-758446010ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:30.554236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54697c-bf06-4a71-8919-758446010ae4 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:30.564238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1385/2743] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:33.559278 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8da18-7a10-4a18-b3bc-745d41af08a0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:33.620960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8da18-7a10-4a18-b3bc-745d41af08a0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:33.625503 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:33.626122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:33.626405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:33.626675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] PATH_INFO: `/v3/users/394c05f2987f4ff7aca0f8fbcc3ba54a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:33.627828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] RBAC: Authorizing `identity:delete_user(user_id=394c05f2987f4ff7aca0f8fbcc3ba54a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:33.629774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:33.674266 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394c05f2987f4ff7aca0f8fbcc3ba54a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:33.686251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394c05f2987f4ff7aca0f8fbcc3ba54a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:33.686898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394c05f2987f4ff7aca0f8fbcc3ba54a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:33.693988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394c05f2987f4ff7aca0f8fbcc3ba54a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:33.694584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394c05f2987f4ff7aca0f8fbcc3ba54a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:33.706400 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1359/2744] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:33 2022] DELETE /identity/v3/users/394c05f2987f4ff7aca0f8fbcc3ba54a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:33.711259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1532-abbb-4cea-9313-dddd0c67cc10 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:33.711727 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1532-abbb-4cea-9313-dddd0c67cc10 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:33.711863 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1532-abbb-4cea-9313-dddd0c67cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:33.730266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4cda1532-abbb-4cea-9313-dddd0c67cc10 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:33.731946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4cda1532-abbb-4cea-9313-dddd0c67cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:33.789027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1386/2745] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:33.798804 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:33.800202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:33.861225 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6270f6-5710-4af2-b9b9-231f745f091f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:33.864860 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1cd1e-d13f-4501-bb91-7e3b3c1b3ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:33.865488 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1cd1e-d13f-4501-bb91-7e3b3c1b3ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:33.865768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1cd1e-d13f-4501-bb91-7e3b3c1b3ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:33.866041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1cd1e-d13f-4501-bb91-7e3b3c1b3ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:33.874836 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1cd1e-d13f-4501-bb91-7e3b3c1b3ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:33.876250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1cd1e-d13f-4501-bb91-7e3b3c1b3ce0 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:33.885468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1360/2746] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:34.145418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1532-abbb-4cea-9313-dddd0c67cc10 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:34.147503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4cda1532-abbb-4cea-9313-dddd0c67cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:34.161487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1532-abbb-4cea-9313-dddd0c67cc10 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:34.166194 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:34.166867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.167079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.167348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] PATH_INFO: `/v3/projects/681381addb714654a47f129c82be66dc` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.168480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=681381addb714654a47f129c82be66dc)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:34.170374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:34.215939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681381addb714654a47f129c82be66dc', 'request_id': 'req-974630a5-2f06-4966-999f-0331ed5b4e66'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:34.221400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681381addb714654a47f129c82be66dc', 'request_id': 'req-974630a5-2f06-4966-999f-0331ed5b4e66'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:34.227449 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681381addb714654a47f129c82be66dc', 'request_id': 'req-974630a5-2f06-4966-999f-0331ed5b4e66'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:34.239579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] The token cache is being invalidate because project 681381addb714654a47f129c82be66dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:34.239879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:34.240474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-974630a5-2f06-4966-999f-0331ed5b4e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:34.241976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1387/2747] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:34 2022] DELETE /identity/v3/projects/681381addb714654a47f129c82be66dc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:34.247390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6a36-ff4e-4917-9ccd-3785f846a7b1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.247680 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6a36-ff4e-4917-9ccd-3785f846a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.247956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6a36-ff4e-4917-9ccd-3785f846a7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.267759 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ea7d6a36-ff4e-4917-9ccd-3785f846a7b1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:34.269065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ea7d6a36-ff4e-4917-9ccd-3785f846a7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:34.285629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:34.329697 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1361/2748] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:34.337622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4305-0502-439b-a047-297135b6c08d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.337909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4305-0502-439b-a047-297135b6c08d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.338182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4305-0502-439b-a047-297135b6c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.358228 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-22bd4305-0502-439b-a047-297135b6c08d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:34.359406 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-22bd4305-0502-439b-a047-297135b6c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:34.367080 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1388/2749] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:34.371065 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d6a36-ff4e-4917-9ccd-3785f846a7b1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:34.380593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d6a36-ff4e-4917-9ccd-3785f846a7b1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:34.385126 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:34.385710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.385986 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.386254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.386929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:07:34.387228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:34.388789 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:34.399914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1362/2750] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:07:34.404355 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd4305-0502-439b-a047-297135b6c08d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:34.413214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd4305-0502-439b-a047-297135b6c08d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:34.417795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee3ce2-0186-4413-9aca-04f9fd2a7c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:34.418985 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee3ce2-0186-4413-9aca-04f9fd2a7c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.419258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee3ce2-0186-4413-9aca-04f9fd2a7c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.420144 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee3ce2-0186-4413-9aca-04f9fd2a7c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.420805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee3ce2-0186-4413-9aca-04f9fd2a7c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:34.422705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee3ce2-0186-4413-9aca-04f9fd2a7c85 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:34.448504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1389/2751] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:34 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:34.453057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:34.463144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664eb16-5ae9-48ce-b91c-3e1ee75bf2b6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:34.517437 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca26db-2f8b-41e6-af43-dc7a5337724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:34.518025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca26db-2f8b-41e6-af43-dc7a5337724f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.518300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca26db-2f8b-41e6-af43-dc7a5337724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.518569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca26db-2f8b-41e6-af43-dc7a5337724f admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.519186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca26db-2f8b-41e6-af43-dc7a5337724f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:34.521093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca26db-2f8b-41e6-af43-dc7a5337724f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:34.545228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1363/2752] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:34 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:07:34.546429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee3ce2-0186-4413-9aca-04f9fd2a7c85 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:34.556759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee3ce2-0186-4413-9aca-04f9fd2a7c85 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:34.561973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa545b21-c930-4b81-b89e-1c3d45aa5040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:34.562587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa545b21-c930-4b81-b89e-1c3d45aa5040 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.562861 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa545b21-c930-4b81-b89e-1c3d45aa5040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.563126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa545b21-c930-4b81-b89e-1c3d45aa5040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.563753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa545b21-c930-4b81-b89e-1c3d45aa5040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:34.565454 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa545b21-c930-4b81-b89e-1c3d45aa5040 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:34.575628 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1390/2753] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:34.579797 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca26db-2f8b-41e6-af43-dc7a5337724f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:34.589740 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca26db-2f8b-41e6-af43-dc7a5337724f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:34.594515 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457629b8-a838-4bad-a072-4a198218e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:34.595118 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457629b8-a838-4bad-a072-4a198218e510 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.595405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457629b8-a838-4bad-a072-4a198218e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.595686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457629b8-a838-4bad-a072-4a198218e510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.596405 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457629b8-a838-4bad-a072-4a198218e510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:34.598037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457629b8-a838-4bad-a072-4a198218e510 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:34.609159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1364/2754] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:07:34.613065 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa545b21-c930-4b81-b89e-1c3d45aa5040 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:34.622726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa545b21-c930-4b81-b89e-1c3d45aa5040 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:34.627207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:34.627838 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.628116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.628389 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] PATH_INFO: `/v3/projects/9d4809291e6040bc8a03feab554235e8/users/81f963c6ffa24eeba28a04ed57773026/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.643022 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4809291e6040bc8a03feab554235e8, user_id=81f963c6ffa24eeba28a04ed57773026, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:34.645650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:34.658747 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1391/2755] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:34 2022] PUT /identity/v3/projects/9d4809291e6040bc8a03feab554235e8/users/81f963c6ffa24eeba28a04ed57773026/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:34.723970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc947-2dd2-4af7-bc5b-631aa0ab83a2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.724258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc947-2dd2-4af7-bc5b-631aa0ab83a2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.724534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fc947-2dd2-4af7-bc5b-631aa0ab83a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.752593 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-852fc947-2dd2-4af7-bc5b-631aa0ab83a2 None None] MFA Rules not processed for user `81f963c6ffa24eeba28a04ed57773026`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:34.753830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-852fc947-2dd2-4af7-bc5b-631aa0ab83a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:34.817075 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1365/2756] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:34.828229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:34.830139 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:34.844806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:34.889193 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a1c89-764c-4720-9c4d-763e17e32a30 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:34.892770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c964-f79e-457e-a984-4efeae2e4374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:34.893404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c964-f79e-457e-a984-4efeae2e4374 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:34.893680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c964-f79e-457e-a984-4efeae2e4374 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:34.893948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c964-f79e-457e-a984-4efeae2e4374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:34.901989 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c964-f79e-457e-a984-4efeae2e4374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:34.903939 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c964-f79e-457e-a984-4efeae2e4374 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:34.912402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1392/2757] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:37.452951 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fc947-2dd2-4af7-bc5b-631aa0ab83a2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:37.472513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:37.556358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fc947-2dd2-4af7-bc5b-631aa0ab83a2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:37.560913 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:37.561561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:37.561837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:37.562106 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] PATH_INFO: `/v3/users/81f963c6ffa24eeba28a04ed57773026` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:37.563211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f963c6ffa24eeba28a04ed57773026)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:37.565140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:37.610311 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f963c6ffa24eeba28a04ed57773026'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:37.622066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f963c6ffa24eeba28a04ed57773026'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:37.622726 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f963c6ffa24eeba28a04ed57773026'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:37.629853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f963c6ffa24eeba28a04ed57773026'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:37.630468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f963c6ffa24eeba28a04ed57773026'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:37.642924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1366/2758] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:07:37 2022] DELETE /identity/v3/users/81f963c6ffa24eeba28a04ed57773026 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:37.647365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7b02c-f52c-453d-9a2b-442dee02918b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:37.647841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7b02c-f52c-453d-9a2b-442dee02918b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:37.647947 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7b02c-f52c-453d-9a2b-442dee02918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:37.694700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e2c7b02c-f52c-453d-9a2b-442dee02918b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:37.695811 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e2c7b02c-f52c-453d-9a2b-442dee02918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:37.752000 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1393/2759] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:37.761561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:37.763550 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:37.822551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:37.838898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2b07-703c-4d4f-8f72-812b38a7a2de admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:37.842631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df14845-2e03-4553-8582-059f78b01a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:37.843241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14845-2e03-4553-8582-059f78b01a82 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:37.843526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14845-2e03-4553-8582-059f78b01a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:37.843801 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df14845-2e03-4553-8582-059f78b01a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:37.852660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df14845-2e03-4553-8582-059f78b01a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:37.854128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df14845-2e03-4553-8582-059f78b01a82 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:37.863584 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1367/2760] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:38.126077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7b02c-f52c-453d-9a2b-442dee02918b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:38.127496 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e2c7b02c-f52c-453d-9a2b-442dee02918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:38.139363 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7b02c-f52c-453d-9a2b-442dee02918b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:38.144012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:38.144635 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.144914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.145223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] PATH_INFO: `/v3/projects/9d4809291e6040bc8a03feab554235e8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.146348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4809291e6040bc8a03feab554235e8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:38.148251 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:38.193650 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4809291e6040bc8a03feab554235e8', 'request_id': 'req-f193ca08-0005-4d22-a05a-864126b51c2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:38.199045 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4809291e6040bc8a03feab554235e8', 'request_id': 'req-f193ca08-0005-4d22-a05a-864126b51c2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:38.205777 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4809291e6040bc8a03feab554235e8', 'request_id': 'req-f193ca08-0005-4d22-a05a-864126b51c2c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:38.218869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] The token cache is being invalidate because project 9d4809291e6040bc8a03feab554235e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:07:38.219154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:38.219801 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f193ca08-0005-4d22-a05a-864126b51c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:07:38.221312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1394/2761] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:07:38 2022] DELETE /identity/v3/projects/9d4809291e6040bc8a03feab554235e8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:38.226349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e2a1-5e6e-4007-83fc-8bbeff2de818 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.226640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e2a1-5e6e-4007-83fc-8bbeff2de818 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.226917 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e2a1-5e6e-4007-83fc-8bbeff2de818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.275104 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6c70e2a1-5e6e-4007-83fc-8bbeff2de818 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:38.276306 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6c70e2a1-5e6e-4007-83fc-8bbeff2de818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:38.334838 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1368/2762] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:07:38.342242 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fd6c-883c-424d-a8e1-f738959e276b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.342526 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fd6c-883c-424d-a8e1-f738959e276b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.342805 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191fd6c-883c-424d-a8e1-f738959e276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.362470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a191fd6c-883c-424d-a8e1-f738959e276b None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:38.363644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a191fd6c-883c-424d-a8e1-f738959e276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:38.371304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1395/2763] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:07:38.375976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70e2a1-5e6e-4007-83fc-8bbeff2de818 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:38.385787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70e2a1-5e6e-4007-83fc-8bbeff2de818 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:38.390466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:38.391064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.391348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.391621 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.392269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:07:38.392573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:38.394192 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:38.405551 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1369/2764] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:07:38.409880 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191fd6c-883c-424d-a8e1-f738959e276b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:38.419648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191fd6c-883c-424d-a8e1-f738959e276b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:38.424231 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201b6da-7a03-4932-8ca9-54c4eae224c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:38.424850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201b6da-7a03-4932-8ca9-54c4eae224c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.425183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201b6da-7a03-4932-8ca9-54c4eae224c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.425456 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201b6da-7a03-4932-8ca9-54c4eae224c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.426106 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201b6da-7a03-4932-8ca9-54c4eae224c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:38.428013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201b6da-7a03-4932-8ca9-54c4eae224c9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:38.432418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:38.456492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1396/2765] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:07:38 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:07:38.460785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:38.470769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08881e0-1254-4ba3-9752-2818ec750989 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:38.526111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0c682-e366-4927-8742-f20b8c4e9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:38.526704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0c682-e366-4927-8742-f20b8c4e9217 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.526985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0c682-e366-4927-8742-f20b8c4e9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.527254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0c682-e366-4927-8742-f20b8c4e9217 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.527895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0c682-e366-4927-8742-f20b8c4e9217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:38.529813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0c682-e366-4927-8742-f20b8c4e9217 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:38.551045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1370/2766] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:07:38 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:07:38.555113 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201b6da-7a03-4932-8ca9-54c4eae224c9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:38.565754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201b6da-7a03-4932-8ca9-54c4eae224c9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:38.570324 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bc605-c163-4464-a4a1-305133ea0fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:38.570916 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc605-c163-4464-a4a1-305133ea0fae admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.571198 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc605-c163-4464-a4a1-305133ea0fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.571472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bc605-c163-4464-a4a1-305133ea0fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.572107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bc605-c163-4464-a4a1-305133ea0fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:38.573773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311bc605-c163-4464-a4a1-305133ea0fae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:38.584566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1397/2767] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:38.588295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0c682-e366-4927-8742-f20b8c4e9217 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:38.598466 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0c682-e366-4927-8742-f20b8c4e9217 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:38.603086 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb8aa7-ea32-48ed-a707-e2e1e687b3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:38.603668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8aa7-ea32-48ed-a707-e2e1e687b3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.603943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8aa7-ea32-48ed-a707-e2e1e687b3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.604211 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb8aa7-ea32-48ed-a707-e2e1e687b3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.604837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8aa7-ea32-48ed-a707-e2e1e687b3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:38.606539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb8aa7-ea32-48ed-a707-e2e1e687b3e5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:38.616790 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1371/2768] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:07:38.620677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bc605-c163-4464-a4a1-305133ea0fae admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:38.630722 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bc605-c163-4464-a4a1-305133ea0fae admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:38.635216 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:38.635849 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.636126 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.636397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] PATH_INFO: `/v3/projects/c579bc4823cb4d5dbed56487c3b356fc/users/bbd71528339e4cf29c7907fc82cd1c34/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.651398 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c579bc4823cb4d5dbed56487c3b356fc, user_id=bbd71528339e4cf29c7907fc82cd1c34, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:38.654240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:38.667345 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1398/2769] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:07:38 2022] PUT /identity/v3/projects/c579bc4823cb4d5dbed56487c3b356fc/users/bbd71528339e4cf29c7907fc82cd1c34/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:07:38.678807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7b3f-f821-4c89-88b9-f41d797f4933 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.679091 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7b3f-f821-4c89-88b9-f41d797f4933 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.679364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7b3f-f821-4c89-88b9-f41d797f4933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.707138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-350d7b3f-f821-4c89-88b9-f41d797f4933 None None] MFA Rules not processed for user `bbd71528339e4cf29c7907fc82cd1c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:07:38.708521 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-350d7b3f-f821-4c89-88b9-f41d797f4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:38.720066 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:38.772317 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1372/2770] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:07:38.784865 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:38.786578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:38.843942 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8559d-105f-4cd4-a635-badecc6cdfb7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:38.847705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2981ee-bae9-41a0-8601-4d2fc7f2bc1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:38.848312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2981ee-bae9-41a0-8601-4d2fc7f2bc1f service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:38.848593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2981ee-bae9-41a0-8601-4d2fc7f2bc1f service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:38.848867 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2981ee-bae9-41a0-8601-4d2fc7f2bc1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:38.857341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2981ee-bae9-41a0-8601-4d2fc7f2bc1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:38.858752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2981ee-bae9-41a0-8601-4d2fc7f2bc1f service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:38.867250 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1399/2771] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:48.625092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d7b3f-f821-4c89-88b9-f41d797f4933 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:07:48.626520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-350d7b3f-f821-4c89-88b9-f41d797f4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:48.718485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d7b3f-f821-4c89-88b9-f41d797f4933 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:07:48.723442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66adb-829c-498e-a23f-78f919af37f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:07:48.724043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66adb-829c-498e-a23f-78f919af37f2 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:07:48.724320 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66adb-829c-498e-a23f-78f919af37f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:07:48.724588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66adb-829c-498e-a23f-78f919af37f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:07:48.726328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-54f66adb-829c-498e-a23f-78f919af37f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:07:48.738233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66adb-829c-498e-a23f-78f919af37f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:07:48.739869 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66adb-829c-498e-a23f-78f919af37f2 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:07:48.749992 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1373/2772] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:07:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:07:48.863396 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:07:58.745665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=62 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:00.368238 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2981ee-bae9-41a0-8601-4d2fc7f2bc1f service glance] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:00.431029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2981ee-bae9-41a0-8601-4d2fc7f2bc1f service glance] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:00.436168 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:00.436814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:00.437140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:00.437413 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] PATH_INFO: `/v3/users/bbd71528339e4cf29c7907fc82cd1c34` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:00.438569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd71528339e4cf29c7907fc82cd1c34)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:00.440564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:00.486032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd71528339e4cf29c7907fc82cd1c34'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:00.497407 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd71528339e4cf29c7907fc82cd1c34'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:00.498591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd71528339e4cf29c7907fc82cd1c34'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:00.505781 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd71528339e4cf29c7907fc82cd1c34'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:00.506523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd71528339e4cf29c7907fc82cd1c34'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:00.519341 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1400/2773] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:00 2022] DELETE /identity/v3/users/bbd71528339e4cf29c7907fc82cd1c34 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:00.523907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d390c-8af2-40c6-8b9d-87f72063d7d9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:00.524386 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d390c-8af2-40c6-8b9d-87f72063d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:00.524485 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d390c-8af2-40c6-8b9d-87f72063d7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:00.543443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-125d390c-8af2-40c6-8b9d-87f72063d7d9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:00.544721 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-125d390c-8af2-40c6-8b9d-87f72063d7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:00.603853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1374/2774] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:00.613548 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:00.614943 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:00.691409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943cb6c-d5fc-4ea1-a4ef-fab620aa2cd0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:00.695156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7b131-5813-49e2-b3b7-fb7b60c1f987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:00.695981 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b131-5813-49e2-b3b7-fb7b60c1f987 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:00.696264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b131-5813-49e2-b3b7-fb7b60c1f987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:00.696533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7b131-5813-49e2-b3b7-fb7b60c1f987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:00.706082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7b131-5813-49e2-b3b7-fb7b60c1f987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:00.707561 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7b131-5813-49e2-b3b7-fb7b60c1f987 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:00.717060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1401/2775] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:00.979251 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d390c-8af2-40c6-8b9d-87f72063d7d9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:00.980749 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-125d390c-8af2-40c6-8b9d-87f72063d7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:00.993807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d390c-8af2-40c6-8b9d-87f72063d7d9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:00.999232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:00.999890 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.000170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.000443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] PATH_INFO: `/v3/projects/c579bc4823cb4d5dbed56487c3b356fc` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.001735 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c579bc4823cb4d5dbed56487c3b356fc)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:01.003645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:01.049963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c579bc4823cb4d5dbed56487c3b356fc', 'request_id': 'req-1fbd4735-36ba-4103-b750-8f1d7c95c414'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:01.057080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c579bc4823cb4d5dbed56487c3b356fc', 'request_id': 'req-1fbd4735-36ba-4103-b750-8f1d7c95c414'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:01.063936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c579bc4823cb4d5dbed56487c3b356fc', 'request_id': 'req-1fbd4735-36ba-4103-b750-8f1d7c95c414'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:01.079165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] The token cache is being invalidate because project c579bc4823cb4d5dbed56487c3b356fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:01.079546 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:01.080191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1fbd4735-36ba-4103-b750-8f1d7c95c414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:01.081926 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1375/2776] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:00 2022] DELETE /identity/v3/projects/c579bc4823cb4d5dbed56487c3b356fc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:01.086809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98bff-50e8-4950-8a89-8f5ed2bfb2e3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.087162 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98bff-50e8-4950-8a89-8f5ed2bfb2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.088164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e98bff-50e8-4950-8a89-8f5ed2bfb2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.096492 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:01.110603 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-93e98bff-50e8-4950-8a89-8f5ed2bfb2e3 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:01.111723 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-93e98bff-50e8-4950-8a89-8f5ed2bfb2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:01.173784 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1402/2777] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:01.181506 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e768c8-5ad1-4342-b964-756560d7d462 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.181824 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e768c8-5ad1-4342-b964-756560d7d462 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.182099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e768c8-5ad1-4342-b964-756560d7d462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.202460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-86e768c8-5ad1-4342-b964-756560d7d462 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:01.203657 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-86e768c8-5ad1-4342-b964-756560d7d462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:01.212822 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1376/2778] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:01.221810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98bff-50e8-4950-8a89-8f5ed2bfb2e3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:01.226858 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e98bff-50e8-4950-8a89-8f5ed2bfb2e3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:01.231321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:01.231934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.232214 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.232485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.233177 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:08:01.233480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:01.235049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:01.246107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1403/2779] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:08:01.250847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e768c8-5ad1-4342-b964-756560d7d462 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:01.260107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e768c8-5ad1-4342-b964-756560d7d462 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:01.265459 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb92ad8-4358-4c07-8639-36a0fb836b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:01.266055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92ad8-4358-4c07-8639-36a0fb836b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.266332 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92ad8-4358-4c07-8639-36a0fb836b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.266601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92ad8-4358-4c07-8639-36a0fb836b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.267232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb92ad8-4358-4c07-8639-36a0fb836b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:01.269136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb92ad8-4358-4c07-8639-36a0fb836b39 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:01.295174 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1377/2780] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:08:01 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:01.300693 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:01.311988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb917559-915c-40be-b788-2a72d923e146 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:01.366726 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91da0-c904-4cfa-b1ed-9b515d75580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:01.367256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91da0-c904-4cfa-b1ed-9b515d75580c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.367533 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91da0-c904-4cfa-b1ed-9b515d75580c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.367803 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91da0-c904-4cfa-b1ed-9b515d75580c admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.368422 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a91da0-c904-4cfa-b1ed-9b515d75580c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:01.370352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a91da0-c904-4cfa-b1ed-9b515d75580c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:01.392262 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1404/2781] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:08:01 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:08:01.396483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb92ad8-4358-4c07-8639-36a0fb836b39 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:01.406944 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb92ad8-4358-4c07-8639-36a0fb836b39 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:01.411761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1302-9548-4b92-b181-1d9fd42dfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:01.412347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1302-9548-4b92-b181-1d9fd42dfdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.412624 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1302-9548-4b92-b181-1d9fd42dfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.412893 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1302-9548-4b92-b181-1d9fd42dfdb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.413634 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1302-9548-4b92-b181-1d9fd42dfdb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:01.415207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1302-9548-4b92-b181-1d9fd42dfdb0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:01.424923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1378/2782] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:01.428675 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91da0-c904-4cfa-b1ed-9b515d75580c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:01.439640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91da0-c904-4cfa-b1ed-9b515d75580c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:01.444166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9114-ec04-4fa8-bf90-0dafd48fcf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:01.444753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9114-ec04-4fa8-bf90-0dafd48fcf5c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.445136 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9114-ec04-4fa8-bf90-0dafd48fcf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.445417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9114-ec04-4fa8-bf90-0dafd48fcf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.446050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9114-ec04-4fa8-bf90-0dafd48fcf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:01.447915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9114-ec04-4fa8-bf90-0dafd48fcf5c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:01.458707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1405/2783] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:08:01.462905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1302-9548-4b92-b181-1d9fd42dfdb0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:01.472582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1302-9548-4b92-b181-1d9fd42dfdb0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:01.477124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:01.477764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.478043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.478335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] PATH_INFO: `/v3/projects/ca29e1d33a734df7a319a9caf0f1d41d/users/4e55ae8991ee418ca08e7320b5582619/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.494748 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca29e1d33a734df7a319a9caf0f1d41d, user_id=4e55ae8991ee418ca08e7320b5582619, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:01.497164 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:01.510073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1379/2784] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:08:01 2022] PUT /identity/v3/projects/ca29e1d33a734df7a319a9caf0f1d41d/users/4e55ae8991ee418ca08e7320b5582619/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:01.520289 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee7bf3-54df-485f-8630-5fec8f14fae6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.520574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee7bf3-54df-485f-8630-5fec8f14fae6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.520875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee7bf3-54df-485f-8630-5fec8f14fae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.548033 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3eee7bf3-54df-485f-8630-5fec8f14fae6 None None] MFA Rules not processed for user `4e55ae8991ee418ca08e7320b5582619`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:01.549256 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3eee7bf3-54df-485f-8630-5fec8f14fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:01.608554 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:01.617160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1406/2785] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:01.626215 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:01.628044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:01.650813 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:01.705568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378cb21-f7d1-483f-b61f-a86228059c5d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:01.709554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c9fca-1129-4d13-b7d1-054ef08e805e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:01.710154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9fca-1129-4d13-b7d1-054ef08e805e service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:01.710436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9fca-1129-4d13-b7d1-054ef08e805e service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:01.710704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c9fca-1129-4d13-b7d1-054ef08e805e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:01.719423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c9fca-1129-4d13-b7d1-054ef08e805e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:01.720828 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c9fca-1129-4d13-b7d1-054ef08e805e service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:01.729499 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1380/2786] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:06.462892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31a2c-10bd-4480-b78f-2bcc5a463478 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:06.463371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31a2c-10bd-4480-b78f-2bcc5a463478 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:06.463472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31a2c-10bd-4480-b78f-2bcc5a463478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:06.483358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-22c31a2c-10bd-4480-b78f-2bcc5a463478 None None] MFA Rules not processed for user `abe38c7883ad4092a2bbcbdd41f0b809`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:06.484559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-22c31a2c-10bd-4480-b78f-2bcc5a463478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:06.542686 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1407/2787] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:08:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:11.704125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c9fca-1129-4d13-b7d1-054ef08e805e service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:11.765956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c9fca-1129-4d13-b7d1-054ef08e805e service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:11.770493 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:11.771115 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:11.771394 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:11.771667 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] PATH_INFO: `/v3/users/4e55ae8991ee418ca08e7320b5582619` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:11.772774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e55ae8991ee418ca08e7320b5582619)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:11.774717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:11.825151 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e55ae8991ee418ca08e7320b5582619'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:11.837348 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e55ae8991ee418ca08e7320b5582619'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:11.838013 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e55ae8991ee418ca08e7320b5582619'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:11.845659 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e55ae8991ee418ca08e7320b5582619'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:11.846265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e55ae8991ee418ca08e7320b5582619'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:11.858880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1381/2788] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:08:11 2022] DELETE /identity/v3/users/4e55ae8991ee418ca08e7320b5582619 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:11.863431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9a81-e270-44be-8b80-e2655e592201 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:11.863910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9a81-e270-44be-8b80-e2655e592201 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:11.864029 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9a81-e270-44be-8b80-e2655e592201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:11.883409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fada9a81-e270-44be-8b80-e2655e592201 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:08:11.884581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fada9a81-e270-44be-8b80-e2655e592201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:11.941692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1408/2789] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:08:11.952042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:11.953471 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:11.980263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:12.012157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8e7f1-4a56-49a5-af4e-05fde06bd926 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:12.016329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:12.016936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:12.017247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:12.017523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:12.026380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:12.027793 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:12.037342 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1382/2790] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:08:12.305701 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada9a81-e270-44be-8b80-e2655e592201 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:08:12.307171 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fada9a81-e270-44be-8b80-e2655e592201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:08:12.320204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada9a81-e270-44be-8b80-e2655e592201 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:08:12.325938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:08:12.326616 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:08:12.326908 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:08:12.327160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] PATH_INFO: `/v3/projects/ca29e1d33a734df7a319a9caf0f1d41d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:08:12.328283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca29e1d33a734df7a319a9caf0f1d41d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:08:12.330961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:08:12.378464 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca29e1d33a734df7a319a9caf0f1d41d', 'request_id': 'req-fe7b4066-8bd0-4c60-be6f-d179181d4554'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:12.383973 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca29e1d33a734df7a319a9caf0f1d41d', 'request_id': 'req-fe7b4066-8bd0-4c60-be6f-d179181d4554'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:12.390358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca29e1d33a734df7a319a9caf0f1d41d', 'request_id': 'req-fe7b4066-8bd0-4c60-be6f-d179181d4554'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:12.402448 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] The token cache is being invalidate because project ca29e1d33a734df7a319a9caf0f1d41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:08:12.402738 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:12.403551 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:08:12.405583 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1409/2791] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:08:12 2022] DELETE /identity/v3/projects/ca29e1d33a734df7a319a9caf0f1d41d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:08:22.033027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=16 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:08:22.399397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:20.459058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:20.460475 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.476382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a073-eee0-4c38-adc3-79da7f7b623a service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:20.536566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:20.537244 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.537526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.537811 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] PATH_INFO: `/v3/users/abe38c7883ad4092a2bbcbdd41f0b809` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.538977 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe38c7883ad4092a2bbcbdd41f0b809)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:20.541556 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:20.593245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe38c7883ad4092a2bbcbdd41f0b809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.604948 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe38c7883ad4092a2bbcbdd41f0b809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.605655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe38c7883ad4092a2bbcbdd41f0b809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.612705 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe38c7883ad4092a2bbcbdd41f0b809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.613378 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dbe74e14-d7b3-4ff7-9f84-fdc93d0b193b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe38c7883ad4092a2bbcbdd41f0b809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.625443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1383/2792] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:20 2022] DELETE /identity/v3/users/abe38c7883ad4092a2bbcbdd41f0b809 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:20.798471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:20.800027 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:20.815279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4066-8bd0-4c60-be6f-d179181d4554 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:20.874773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:20.875408 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.875687 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.875965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] PATH_INFO: `/v3/projects/b10da9e8a7f74d0e8df34fe02393ce31` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.877637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10da9e8a7f74d0e8df34fe02393ce31)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:20.879560 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:20.923834 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10da9e8a7f74d0e8df34fe02393ce31', 'request_id': 'req-86e76311-3fc4-4ab7-af8c-ddb576798732'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.929282 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10da9e8a7f74d0e8df34fe02393ce31', 'request_id': 'req-86e76311-3fc4-4ab7-af8c-ddb576798732'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.935288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10da9e8a7f74d0e8df34fe02393ce31', 'request_id': 'req-86e76311-3fc4-4ab7-af8c-ddb576798732'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.947416 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] The token cache is being invalidate because project b10da9e8a7f74d0e8df34fe02393ce31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:20.947691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.948301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-86e76311-3fc4-4ab7-af8c-ddb576798732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:20.949774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1410/2793] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:20 2022] DELETE /identity/v3/projects/b10da9e8a7f74d0e8df34fe02393ce31 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:20.954671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2ccc-ade5-4652-b1f5-c7f476b3d5e7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:20.955538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2ccc-ade5-4652-b1f5-c7f476b3d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:20.955818 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f2ccc-ade5-4652-b1f5-c7f476b3d5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:20.975376 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f21f2ccc-ade5-4652-b1f5-c7f476b3d5e7 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:20.976512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f21f2ccc-ade5-4652-b1f5-c7f476b3d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.034012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1384/2794] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:21.042599 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5333c8-4aaa-47ea-85de-81f427915f60 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.042888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5333c8-4aaa-47ea-85de-81f427915f60 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.043164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5333c8-4aaa-47ea-85de-81f427915f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.062531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0c5333c8-4aaa-47ea-85de-81f427915f60 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:21.063709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0c5333c8-4aaa-47ea-85de-81f427915f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.071350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1411/2795] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:21.075531 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2ccc-ade5-4652-b1f5-c7f476b3d5e7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.085678 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f2ccc-ade5-4652-b1f5-c7f476b3d5e7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.090166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.091016 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.091289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.091557 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.092195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:21.092494 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.094179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.106060 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1385/2796] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:21.110112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5333c8-4aaa-47ea-85de-81f427915f60 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.119143 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5333c8-4aaa-47ea-85de-81f427915f60 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.123694 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd00cb4-8b00-42b2-8d0f-e7d605ce709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.124277 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00cb4-8b00-42b2-8d0f-e7d605ce709c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.124555 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00cb4-8b00-42b2-8d0f-e7d605ce709c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.124845 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd00cb4-8b00-42b2-8d0f-e7d605ce709c admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.125541 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd00cb4-8b00-42b2-8d0f-e7d605ce709c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.127412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd00cb4-8b00-42b2-8d0f-e7d605ce709c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.153800 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1412/2797] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:21.157810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.168068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae24628-d4a8-444d-a331-217622a040ad admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.171545 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:21.224532 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaa022-080c-4d6b-a8df-47c4ada41192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.225232 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaa022-080c-4d6b-a8df-47c4ada41192 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.225562 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaa022-080c-4d6b-a8df-47c4ada41192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.225784 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaa022-080c-4d6b-a8df-47c4ada41192 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.226412 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaa022-080c-4d6b-a8df-47c4ada41192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.228299 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaa022-080c-4d6b-a8df-47c4ada41192 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.248516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1386/2798] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:21.252648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd00cb4-8b00-42b2-8d0f-e7d605ce709c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.262736 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd00cb4-8b00-42b2-8d0f-e7d605ce709c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.267196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591799-4305-4944-811c-9a3eea540b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.268288 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591799-4305-4944-811c-9a3eea540b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.268563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591799-4305-4944-811c-9a3eea540b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.268832 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04591799-4305-4944-811c-9a3eea540b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.269502 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04591799-4305-4944-811c-9a3eea540b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.271077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04591799-4305-4944-811c-9a3eea540b4e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.280758 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1413/2799] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:21.285078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaa022-080c-4d6b-a8df-47c4ada41192 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.294717 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaa022-080c-4d6b-a8df-47c4ada41192 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.299271 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87658372-f06b-49eb-9aef-15466c1a6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.299859 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87658372-f06b-49eb-9aef-15466c1a6703 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.300137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87658372-f06b-49eb-9aef-15466c1a6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.300410 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87658372-f06b-49eb-9aef-15466c1a6703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.301069 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87658372-f06b-49eb-9aef-15466c1a6703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.302640 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87658372-f06b-49eb-9aef-15466c1a6703 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.313024 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1387/2800] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:21.316899 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591799-4305-4944-811c-9a3eea540b4e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.326709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04591799-4305-4944-811c-9a3eea540b4e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.331749 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492f31a-45f5-4121-96e7-044437261f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.332379 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492f31a-45f5-4121-96e7-044437261f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.332659 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492f31a-45f5-4121-96e7-044437261f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.332929 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492f31a-45f5-4121-96e7-044437261f08 admin admin] PATH_INFO: `/v3/projects/49cd156edd9a465dbda83da89f73ca6b/users/d798f2a52dda48f3b5fde580ce6a767e/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.347725 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492f31a-45f5-4121-96e7-044437261f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cd156edd9a465dbda83da89f73ca6b, user_id=d798f2a52dda48f3b5fde580ce6a767e, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.350394 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492f31a-45f5-4121-96e7-044437261f08 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.363640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1414/2801] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:21 2022] PUT /identity/v3/projects/49cd156edd9a465dbda83da89f73ca6b/users/d798f2a52dda48f3b5fde580ce6a767e/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:21.373658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a26d4-c434-4ae4-b1ec-0e343d070011 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.373946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a26d4-c434-4ae4-b1ec-0e343d070011 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.374250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a26d4-c434-4ae4-b1ec-0e343d070011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.401582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-545a26d4-c434-4ae4-b1ec-0e343d070011 None None] MFA Rules not processed for user `d798f2a52dda48f3b5fde580ce6a767e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:21.402786 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-545a26d4-c434-4ae4-b1ec-0e343d070011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.466101 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1388/2802] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:21.471038 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492f31a-45f5-4121-96e7-044437261f08 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.500142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:21.534352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492f31a-45f5-4121-96e7-044437261f08 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.538928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32810671-0da9-442c-94c1-a7b1f66ded83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.539529 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32810671-0da9-442c-94c1-a7b1f66ded83 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.539809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32810671-0da9-442c-94c1-a7b1f66ded83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.540089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32810671-0da9-442c-94c1-a7b1f66ded83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.540702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32810671-0da9-442c-94c1-a7b1f66ded83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.542622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32810671-0da9-442c-94c1-a7b1f66ded83 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.569044 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1415/2803] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:21.573136 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a26d4-c434-4ae4-b1ec-0e343d070011 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.584233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a26d4-c434-4ae4-b1ec-0e343d070011 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.641796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db3ab-3192-4d5f-b4c5-ef7259dd9e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.642393 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db3ab-3192-4d5f-b4c5-ef7259dd9e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.642671 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db3ab-3192-4d5f-b4c5-ef7259dd9e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.643233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50db3ab-3192-4d5f-b4c5-ef7259dd9e11 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.643618 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50db3ab-3192-4d5f-b4c5-ef7259dd9e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.645554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50db3ab-3192-4d5f-b4c5-ef7259dd9e11 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.666698 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1389/2804] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:21.670779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32810671-0da9-442c-94c1-a7b1f66ded83 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.681452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32810671-0da9-442c-94c1-a7b1f66ded83 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.685963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf32fd-cf7a-4f1d-be69-55500d9ffa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.686580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf32fd-cf7a-4f1d-be69-55500d9ffa77 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.686862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf32fd-cf7a-4f1d-be69-55500d9ffa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.687132 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf32fd-cf7a-4f1d-be69-55500d9ffa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.687759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf32fd-cf7a-4f1d-be69-55500d9ffa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.689440 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf32fd-cf7a-4f1d-be69-55500d9ffa77 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.699578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1416/2805] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:21.703482 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db3ab-3192-4d5f-b4c5-ef7259dd9e11 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.710202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:21.713973 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50db3ab-3192-4d5f-b4c5-ef7259dd9e11 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.719635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b9cb9-ba62-4cf6-9547-7fe8a9518fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.720274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b9cb9-ba62-4cf6-9547-7fe8a9518fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.720553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b9cb9-ba62-4cf6-9547-7fe8a9518fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.721469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b9cb9-ba62-4cf6-9547-7fe8a9518fb6 admin admin] PATH_INFO: `/v3/projects/56535fcec1cb40acb1729a2321f8f792/users/20ceb252d3fb4459a3b1ed4595b95203/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.735776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b9cb9-ba62-4cf6-9547-7fe8a9518fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56535fcec1cb40acb1729a2321f8f792, user_id=20ceb252d3fb4459a3b1ed4595b95203, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.738487 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b9cb9-ba62-4cf6-9547-7fe8a9518fb6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.751027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1390/2806] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:21 2022] PUT /identity/v3/projects/56535fcec1cb40acb1729a2321f8f792/users/20ceb252d3fb4459a3b1ed4595b95203/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:21.754847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf32fd-cf7a-4f1d-be69-55500d9ffa77 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.764589 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf32fd-cf7a-4f1d-be69-55500d9ffa77 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.821024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a93d7-810c-47d2-bdba-0b5ca927f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.821658 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a93d7-810c-47d2-bdba-0b5ca927f699 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.821892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a93d7-810c-47d2-bdba-0b5ca927f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.822159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a93d7-810c-47d2-bdba-0b5ca927f699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.822815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a93d7-810c-47d2-bdba-0b5ca927f699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.824395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a93d7-810c-47d2-bdba-0b5ca927f699 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.834421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1417/2807] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:21.838599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b9cb9-ba62-4cf6-9547-7fe8a9518fb6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.849674 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b9cb9-ba62-4cf6-9547-7fe8a9518fb6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:21.854337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:21.854974 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.855254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.855529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] PATH_INFO: `/v3/projects/56535fcec1cb40acb1729a2321f8f792/users/20ceb252d3fb4459a3b1ed4595b95203/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.857491 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56535fcec1cb40acb1729a2321f8f792, user_id=20ceb252d3fb4459a3b1ed4595b95203, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:21.860108 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:21.870358 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1391/2808] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:21 2022] PUT /identity/v3/projects/56535fcec1cb40acb1729a2321f8f792/users/20ceb252d3fb4459a3b1ed4595b95203/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:21.880291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76886ed8-23b2-4d93-a85a-2c32ff657855 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:21.880579 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76886ed8-23b2-4d93-a85a-2c32ff657855 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:21.880854 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76886ed8-23b2-4d93-a85a-2c32ff657855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:21.907871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-76886ed8-23b2-4d93-a85a-2c32ff657855 None None] MFA Rules not processed for user `20ceb252d3fb4459a3b1ed4595b95203`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:21.909651 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-76886ed8-23b2-4d93-a85a-2c32ff657855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:21.975458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1418/2809] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:21.988512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:21.990256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:22.046018 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242e9e0-19af-4152-975e-9f1e6c53a84a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:22.050241 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c25718-10d2-4b2b-8c33-5eff371e069a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.050834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c25718-10d2-4b2b-8c33-5eff371e069a service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.051112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c25718-10d2-4b2b-8c33-5eff371e069a service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.051384 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c25718-10d2-4b2b-8c33-5eff371e069a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.060170 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c25718-10d2-4b2b-8c33-5eff371e069a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.061637 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c25718-10d2-4b2b-8c33-5eff371e069a service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:22.071691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1392/2810] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:22.146907 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76886ed8-23b2-4d93-a85a-2c32ff657855 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:22.156452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76886ed8-23b2-4d93-a85a-2c32ff657855 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:22.160545 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c2d7f-56ff-4418-ad41-2691e84b2d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:22.161178 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2d7f-56ff-4418-ad41-2691e84b2d36 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:22.161462 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2d7f-56ff-4418-ad41-2691e84b2d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:22.161730 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c2d7f-56ff-4418-ad41-2691e84b2d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:22.180196 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:22.217637 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c2d7f-56ff-4418-ad41-2691e84b2d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:22.219057 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c2d7f-56ff-4418-ad41-2691e84b2d36 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:22.228184 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1419/2811] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:32.072402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:32.224229 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=18 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:51.166743 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c25718-10d2-4b2b-8c33-5eff371e069a service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:51.228398 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c25718-10d2-4b2b-8c33-5eff371e069a service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:51.232895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:51.233537 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:51.233816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:51.234089 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] PATH_INFO: `/v3/users/d798f2a52dda48f3b5fde580ce6a767e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:51.235201 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d798f2a52dda48f3b5fde580ce6a767e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:51.237126 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:51.282547 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd798f2a52dda48f3b5fde580ce6a767e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.294369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd798f2a52dda48f3b5fde580ce6a767e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.295030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd798f2a52dda48f3b5fde580ce6a767e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.303691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd798f2a52dda48f3b5fde580ce6a767e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.304309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd798f2a52dda48f3b5fde580ce6a767e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.317169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1393/2812] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:51 2022] DELETE /identity/v3/users/d798f2a52dda48f3b5fde580ce6a767e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:51.321546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c376-dd39-4c81-94de-de3d059efac6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:51.322028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c376-dd39-4c81-94de-de3d059efac6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:51.322128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7c376-dd39-4c81-94de-de3d059efac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:51.340411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1ee7c376-dd39-4c81-94de-de3d059efac6 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:51.341602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1ee7c376-dd39-4c81-94de-de3d059efac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:51.397796 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1420/2813] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:51.407235 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:51.408670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:51.464558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c25ae-71fc-44ac-8bf7-2f427df8b28c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:51.468474 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad1830-a94f-4657-bf0a-c730861dc033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:51.469093 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad1830-a94f-4657-bf0a-c730861dc033 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:51.469371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad1830-a94f-4657-bf0a-c730861dc033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:51.469636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad1830-a94f-4657-bf0a-c730861dc033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:51.478416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad1830-a94f-4657-bf0a-c730861dc033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:51.479817 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad1830-a94f-4657-bf0a-c730861dc033 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:51.489003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1394/2814] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:51.748516 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7c376-dd39-4c81-94de-de3d059efac6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:51.751901 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1ee7c376-dd39-4c81-94de-de3d059efac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:51.768234 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7c376-dd39-4c81-94de-de3d059efac6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:51.775392 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:51.776030 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:51.776291 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:51.776557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] PATH_INFO: `/v3/projects/49cd156edd9a465dbda83da89f73ca6b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:51.777765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cd156edd9a465dbda83da89f73ca6b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:51.779669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:51.826737 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cd156edd9a465dbda83da89f73ca6b', 'request_id': 'req-01dd9817-9d98-4e81-bbba-00dd88b7aaac'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.832564 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cd156edd9a465dbda83da89f73ca6b', 'request_id': 'req-01dd9817-9d98-4e81-bbba-00dd88b7aaac'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.841028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cd156edd9a465dbda83da89f73ca6b', 'request_id': 'req-01dd9817-9d98-4e81-bbba-00dd88b7aaac'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.853875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] The token cache is being invalidate because project 49cd156edd9a465dbda83da89f73ca6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:51.854164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.854783 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.856249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1421/2815] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:51 2022] DELETE /identity/v3/projects/49cd156edd9a465dbda83da89f73ca6b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:51.860286 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad1830-a94f-4657-bf0a-c730861dc033 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:51.871010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad1830-a94f-4657-bf0a-c730861dc033 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:51.889369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:51.929078 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:51.929714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:51.929999 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:51.930274 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] PATH_INFO: `/v3/users/20ceb252d3fb4459a3b1ed4595b95203` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:51.931390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ceb252d3fb4459a3b1ed4595b95203)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:51.933347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:51.978783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ceb252d3fb4459a3b1ed4595b95203'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.991042 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ceb252d3fb4459a3b1ed4595b95203'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.991725 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ceb252d3fb4459a3b1ed4595b95203'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.999057 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ceb252d3fb4459a3b1ed4595b95203'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:51.999676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90693a68-6b5b-4057-8e63-cfe530e30822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ceb252d3fb4459a3b1ed4595b95203'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:52.012111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1395/2816] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:09:51 2022] DELETE /identity/v3/users/20ceb252d3fb4459a3b1ed4595b95203 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:52.277754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:52.279342 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:52.292504 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd9817-9d98-4e81-bbba-00dd88b7aaac admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:52.347523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:52.348182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.348409 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.348676 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] PATH_INFO: `/v3/projects/56535fcec1cb40acb1729a2321f8f792` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.349799 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=56535fcec1cb40acb1729a2321f8f792)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:52.351677 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:52.381103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:52.399072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56535fcec1cb40acb1729a2321f8f792', 'request_id': 'req-e88c1f64-087e-4b3b-bbec-b0d44af721ba'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:52.404350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56535fcec1cb40acb1729a2321f8f792', 'request_id': 'req-e88c1f64-087e-4b3b-bbec-b0d44af721ba'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:52.410379 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56535fcec1cb40acb1729a2321f8f792', 'request_id': 'req-e88c1f64-087e-4b3b-bbec-b0d44af721ba'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:52.422024 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] The token cache is being invalidate because project 56535fcec1cb40acb1729a2321f8f792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:09:52.422312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:52.422957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e88c1f64-087e-4b3b-bbec-b0d44af721ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:09:52.424404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1422/2817] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:09:52 2022] DELETE /identity/v3/projects/56535fcec1cb40acb1729a2321f8f792 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:52.429390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16293ed-47d7-45e6-891d-c016755f9797 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.429898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16293ed-47d7-45e6-891d-c016755f9797 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.430030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16293ed-47d7-45e6-891d-c016755f9797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.449535 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f16293ed-47d7-45e6-891d-c016755f9797 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:52.450716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f16293ed-47d7-45e6-891d-c016755f9797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:52.507538 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1396/2818] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:52.515376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe464-2408-48ad-94e5-5f93a41b68c9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.515663 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe464-2408-48ad-94e5-5f93a41b68c9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.515941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafe464-2408-48ad-94e5-5f93a41b68c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.535559 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7cafe464-2408-48ad-94e5-5f93a41b68c9 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:52.536742 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7cafe464-2408-48ad-94e5-5f93a41b68c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:52.544485 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1423/2819] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:52.548606 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16293ed-47d7-45e6-891d-c016755f9797 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:52.558760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16293ed-47d7-45e6-891d-c016755f9797 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:52.563370 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:52.563965 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.564248 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.564524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.565202 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:09:52.565510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:52.567745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:52.579183 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1397/2820] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:09:52.583452 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafe464-2408-48ad-94e5-5f93a41b68c9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:52.592662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafe464-2408-48ad-94e5-5f93a41b68c9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:52.597527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfb4bd-55fd-40b8-85b2-49fdafa66233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:52.598116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfb4bd-55fd-40b8-85b2-49fdafa66233 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.598393 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfb4bd-55fd-40b8-85b2-49fdafa66233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.598661 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfb4bd-55fd-40b8-85b2-49fdafa66233 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.599279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfb4bd-55fd-40b8-85b2-49fdafa66233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:52.601183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfb4bd-55fd-40b8-85b2-49fdafa66233 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:52.636755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1424/2821] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:52 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:52.640953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:52.650916 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dc1ec-db58-4afc-a04e-bb07b92a24f1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:52.676401 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:52.708827 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10f142-ee5f-42fe-8b05-6cb13c762931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:52.709463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10f142-ee5f-42fe-8b05-6cb13c762931 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.709771 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10f142-ee5f-42fe-8b05-6cb13c762931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.710045 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10f142-ee5f-42fe-8b05-6cb13c762931 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.710675 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10f142-ee5f-42fe-8b05-6cb13c762931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:52.712577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10f142-ee5f-42fe-8b05-6cb13c762931 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:52.733107 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1398/2822] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:52 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:52.737270 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfb4bd-55fd-40b8-85b2-49fdafa66233 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:52.747868 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfb4bd-55fd-40b8-85b2-49fdafa66233 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:52.752600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d770-0533-4b69-a0f8-7573a9e68561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:52.753235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d770-0533-4b69-a0f8-7573a9e68561 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.753573 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d770-0533-4b69-a0f8-7573a9e68561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.753869 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53d770-0533-4b69-a0f8-7573a9e68561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.754539 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53d770-0533-4b69-a0f8-7573a9e68561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:52.756129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53d770-0533-4b69-a0f8-7573a9e68561 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:52.765911 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1425/2823] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:52.770257 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10f142-ee5f-42fe-8b05-6cb13c762931 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:52.780529 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10f142-ee5f-42fe-8b05-6cb13c762931 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:52.785325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4283b0-6fce-4c00-a395-285bff830c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:52.785946 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4283b0-6fce-4c00-a395-285bff830c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.786228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4283b0-6fce-4c00-a395-285bff830c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.786500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4283b0-6fce-4c00-a395-285bff830c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.787138 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4283b0-6fce-4c00-a395-285bff830c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:52.788757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4283b0-6fce-4c00-a395-285bff830c5a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:52.798685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1399/2824] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:52.803082 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d770-0533-4b69-a0f8-7573a9e68561 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:52.815428 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53d770-0533-4b69-a0f8-7573a9e68561 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:52.820574 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431ca7a-d734-4d1c-a264-da5daa13b1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:52.821240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431ca7a-d734-4d1c-a264-da5daa13b1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.821520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431ca7a-d734-4d1c-a264-da5daa13b1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.821790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431ca7a-d734-4d1c-a264-da5daa13b1ea admin admin] PATH_INFO: `/v3/projects/9184882505174fe29e1cdcc6512954be/users/94d7219f4d3e4127858e545dd7a9188a/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.836009 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431ca7a-d734-4d1c-a264-da5daa13b1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9184882505174fe29e1cdcc6512954be, user_id=94d7219f4d3e4127858e545dd7a9188a, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:52.838644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431ca7a-d734-4d1c-a264-da5daa13b1ea admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:52.851887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1426/2825] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:52 2022] PUT /identity/v3/projects/9184882505174fe29e1cdcc6512954be/users/94d7219f4d3e4127858e545dd7a9188a/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:52.863467 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd6593-f729-45c6-b890-30979984cc0b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:52.863756 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd6593-f729-45c6-b890-30979984cc0b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:52.864112 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd6593-f729-45c6-b890-30979984cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:52.892670 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a6fd6593-f729-45c6-b890-30979984cc0b None None] MFA Rules not processed for user `94d7219f4d3e4127858e545dd7a9188a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:52.893935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a6fd6593-f729-45c6-b890-30979984cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:52.955654 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1400/2826] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:52.960640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431ca7a-d734-4d1c-a264-da5daa13b1ea admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.020160 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431ca7a-d734-4d1c-a264-da5daa13b1ea admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.024745 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ffaf-3420-41f2-89a3-8c0311586dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.025472 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ffaf-3420-41f2-89a3-8c0311586dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.025752 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ffaf-3420-41f2-89a3-8c0311586dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.026069 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5ffaf-3420-41f2-89a3-8c0311586dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.026688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5ffaf-3420-41f2-89a3-8c0311586dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.028614 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5ffaf-3420-41f2-89a3-8c0311586dc0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.054444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1427/2827] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:52 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:53.058524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd6593-f729-45c6-b890-30979984cc0b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.069636 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd6593-f729-45c6-b890-30979984cc0b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.123560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9963c-1d46-4ee4-9352-fadcf638e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.124159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9963c-1d46-4ee4-9352-fadcf638e73f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.124433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9963c-1d46-4ee4-9352-fadcf638e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.124700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9963c-1d46-4ee4-9352-fadcf638e73f admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.125352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9963c-1d46-4ee4-9352-fadcf638e73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.127231 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9963c-1d46-4ee4-9352-fadcf638e73f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.148980 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1401/2828] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:53 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:09:53.152908 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ffaf-3420-41f2-89a3-8c0311586dc0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.163072 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5ffaf-3420-41f2-89a3-8c0311586dc0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.167716 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5eff-9cff-47c7-9691-567800694845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.168344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5eff-9cff-47c7-9691-567800694845 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.169066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5eff-9cff-47c7-9691-567800694845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.169066 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5eff-9cff-47c7-9691-567800694845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.169563 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5eff-9cff-47c7-9691-567800694845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.171337 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5eff-9cff-47c7-9691-567800694845 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.181959 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1428/2829] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:53.185950 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9963c-1d46-4ee4-9352-fadcf638e73f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.196287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9963c-1d46-4ee4-9352-fadcf638e73f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.200780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00d746-6d9b-4198-a499-1a36b21f4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.201407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d746-6d9b-4198-a499-1a36b21f4c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.201684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d746-6d9b-4198-a499-1a36b21f4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.201956 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d746-6d9b-4198-a499-1a36b21f4c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.202583 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00d746-6d9b-4198-a499-1a36b21f4c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.204140 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00d746-6d9b-4198-a499-1a36b21f4c39 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.214381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1402/2830] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:53.218052 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5eff-9cff-47c7-9691-567800694845 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.227914 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5eff-9cff-47c7-9691-567800694845 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.232447 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270cac2-e962-49a3-a1a6-4838e12e0b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.233152 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270cac2-e962-49a3-a1a6-4838e12e0b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.233434 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270cac2-e962-49a3-a1a6-4838e12e0b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.233707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270cac2-e962-49a3-a1a6-4838e12e0b7b admin admin] PATH_INFO: `/v3/projects/fd1ee615029a44ccbd9274d189208f1e/users/75a9900e0e5b46f2b5e3a8a419c1fa11/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.246814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:53.250391 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270cac2-e962-49a3-a1a6-4838e12e0b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1ee615029a44ccbd9274d189208f1e, user_id=75a9900e0e5b46f2b5e3a8a419c1fa11, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.253593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270cac2-e962-49a3-a1a6-4838e12e0b7b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.266909 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1429/2831] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:53 2022] PUT /identity/v3/projects/fd1ee615029a44ccbd9274d189208f1e/users/75a9900e0e5b46f2b5e3a8a419c1fa11/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:53.277775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60788-fd17-455b-8c1a-8419681c3966 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.278067 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60788-fd17-455b-8c1a-8419681c3966 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.278375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60788-fd17-455b-8c1a-8419681c3966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.307533 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-13f60788-fd17-455b-8c1a-8419681c3966 None None] MFA Rules not processed for user `75a9900e0e5b46f2b5e3a8a419c1fa11`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:53.308791 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-13f60788-fd17-455b-8c1a-8419681c3966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:53.312732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:53.373461 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1403/2832] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:09:53.377923 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270cac2-e962-49a3-a1a6-4838e12e0b7b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.438019 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270cac2-e962-49a3-a1a6-4838e12e0b7b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.443239 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441a197-f734-4bee-8336-28eefb8db089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.443835 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441a197-f734-4bee-8336-28eefb8db089 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.444116 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441a197-f734-4bee-8336-28eefb8db089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.444390 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441a197-f734-4bee-8336-28eefb8db089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.445032 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441a197-f734-4bee-8336-28eefb8db089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.446956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441a197-f734-4bee-8336-28eefb8db089 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.473744 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1430/2833] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:09:53 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:53.477713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60788-fd17-455b-8c1a-8419681c3966 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.488647 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60788-fd17-455b-8c1a-8419681c3966 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.541938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce4685-e7e9-47c8-8b6d-087e7cd65e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.542536 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4685-e7e9-47c8-8b6d-087e7cd65e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.542829 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4685-e7e9-47c8-8b6d-087e7cd65e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.543083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce4685-e7e9-47c8-8b6d-087e7cd65e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.543694 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce4685-e7e9-47c8-8b6d-087e7cd65e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.545615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce4685-e7e9-47c8-8b6d-087e7cd65e86 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.566704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1404/2834] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:09:53 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:09:53.570692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441a197-f734-4bee-8336-28eefb8db089 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.581523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441a197-f734-4bee-8336-28eefb8db089 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.586785 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a3720-c91c-458f-b76d-e5e5888527bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.587412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3720-c91c-458f-b76d-e5e5888527bb admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.587691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3720-c91c-458f-b76d-e5e5888527bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.587965 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3720-c91c-458f-b76d-e5e5888527bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.588630 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a3720-c91c-458f-b76d-e5e5888527bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.590236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a3720-c91c-458f-b76d-e5e5888527bb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.601316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1431/2835] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:53.605294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce4685-e7e9-47c8-8b6d-087e7cd65e86 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.615688 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce4685-e7e9-47c8-8b6d-087e7cd65e86 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.620476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8d19-e80b-4626-b8be-b2b2dc49df3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.621178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8d19-e80b-4626-b8be-b2b2dc49df3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.621460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8d19-e80b-4626-b8be-b2b2dc49df3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.621757 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8d19-e80b-4626-b8be-b2b2dc49df3f admin admin] PATH_INFO: `/v3/projects/30ad4068e2bd4a2b85fe3e3878402b91/users/d2ba06d35e504a1996e8d587755b362a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.636441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8d19-e80b-4626-b8be-b2b2dc49df3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ad4068e2bd4a2b85fe3e3878402b91, user_id=d2ba06d35e504a1996e8d587755b362a, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.639134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8d19-e80b-4626-b8be-b2b2dc49df3f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.651539 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1405/2836] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:53 2022] PUT /identity/v3/projects/30ad4068e2bd4a2b85fe3e3878402b91/users/d2ba06d35e504a1996e8d587755b362a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:09:53.655700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a3720-c91c-458f-b76d-e5e5888527bb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.665814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a3720-c91c-458f-b76d-e5e5888527bb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.720296 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c793f-ef20-4054-af16-3bc2548c7a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.720891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c793f-ef20-4054-af16-3bc2548c7a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.721199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c793f-ef20-4054-af16-3bc2548c7a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.721471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c793f-ef20-4054-af16-3bc2548c7a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.722095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c793f-ef20-4054-af16-3bc2548c7a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.724258 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c793f-ef20-4054-af16-3bc2548c7a6a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.733536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1432/2837] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:09:53.737746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8d19-e80b-4626-b8be-b2b2dc49df3f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.748280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8d19-e80b-4626-b8be-b2b2dc49df3f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.752853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.753530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.753809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.754081 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] PATH_INFO: `/v3/projects/30ad4068e2bd4a2b85fe3e3878402b91/users/d2ba06d35e504a1996e8d587755b362a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.755993 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ad4068e2bd4a2b85fe3e3878402b91, user_id=d2ba06d35e504a1996e8d587755b362a, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.758629 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.768882 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1406/2838] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:09:53 2022] PUT /identity/v3/projects/30ad4068e2bd4a2b85fe3e3878402b91/users/d2ba06d35e504a1996e8d587755b362a/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:09:53.778705 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ab1b-1b6a-472e-8bfb-3f963f60f9f1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.778987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ab1b-1b6a-472e-8bfb-3f963f60f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.779283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ab1b-1b6a-472e-8bfb-3f963f60f9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.807190 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2380ab1b-1b6a-472e-8bfb-3f963f60f9f1 None None] MFA Rules not processed for user `d2ba06d35e504a1996e8d587755b362a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:09:53.808410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2380ab1b-1b6a-472e-8bfb-3f963f60f9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:53.854431 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:53.877790 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1433/2839] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:09:53.888635 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:53.890486 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:53.946660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877b46b-87a5-4e69-aa84-8458e648b238 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:53.950314 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82c822-d1c8-4f8b-9923-ec2d87af19e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:53.950905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82c822-d1c8-4f8b-9923-ec2d87af19e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:53.951186 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82c822-d1c8-4f8b-9923-ec2d87af19e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:53.951457 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82c822-d1c8-4f8b-9923-ec2d87af19e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:53.961097 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82c822-d1c8-4f8b-9923-ec2d87af19e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:53.962513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82c822-d1c8-4f8b-9923-ec2d87af19e2 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:53.967337 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:09:53.973321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1407/2840] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:54.458778 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380ab1b-1b6a-472e-8bfb-3f963f60f9f1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:54.460204 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2380ab1b-1b6a-472e-8bfb-3f963f60f9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:09:54.471982 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380ab1b-1b6a-472e-8bfb-3f963f60f9f1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:54.476012 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da622c8d-1aae-4136-b6ce-21a6f14d0440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:54.476600 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da622c8d-1aae-4136-b6ce-21a6f14d0440 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:54.476875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da622c8d-1aae-4136-b6ce-21a6f14d0440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:54.477172 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da622c8d-1aae-4136-b6ce-21a6f14d0440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:54.530882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da622c8d-1aae-4136-b6ce-21a6f14d0440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:54.532284 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da622c8d-1aae-4136-b6ce-21a6f14d0440 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:54.541350 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1434/2841] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:09:58.541665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82c822-d1c8-4f8b-9923-ec2d87af19e2 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:09:58.550422 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82c822-d1c8-4f8b-9923-ec2d87af19e2 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:09:58.554561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e5360-c8a5-4b80-87bd-e24dfb971a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:09:58.555154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5360-c8a5-4b80-87bd-e24dfb971a89 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:09:58.555437 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5360-c8a5-4b80-87bd-e24dfb971a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:09:58.555712 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5360-c8a5-4b80-87bd-e24dfb971a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:09:58.612904 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e5360-c8a5-4b80-87bd-e24dfb971a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:09:58.614785 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e5360-c8a5-4b80-87bd-e24dfb971a89 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:09:58.623469 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1408/2842] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:09:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:00.676882 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da622c8d-1aae-4136-b6ce-21a6f14d0440 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:00.737493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da622c8d-1aae-4136-b6ce-21a6f14d0440 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:00.742480 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:00.743101 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:00.743385 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:00.743654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] PATH_INFO: `/v3/users/94d7219f4d3e4127858e545dd7a9188a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:00.744755 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d7219f4d3e4127858e545dd7a9188a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:00.746690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:00.791050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d7219f4d3e4127858e545dd7a9188a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.803077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d7219f4d3e4127858e545dd7a9188a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.803733 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d7219f4d3e4127858e545dd7a9188a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.811320 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d7219f4d3e4127858e545dd7a9188a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.812023 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d7219f4d3e4127858e545dd7a9188a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:00.825316 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1435/2843] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:00 2022] DELETE /identity/v3/users/94d7219f4d3e4127858e545dd7a9188a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:00.829742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7041-cc7b-477b-bae6-d3f2f0464fcb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:00.830230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7041-cc7b-477b-bae6-d3f2f0464fcb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:00.830340 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7041-cc7b-477b-bae6-d3f2f0464fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:00.849250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-736f7041-cc7b-477b-bae6-d3f2f0464fcb None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:00.850375 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-736f7041-cc7b-477b-bae6-d3f2f0464fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:00.907848 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1409/2844] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:00.917450 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:00.918864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:00.925189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:00.976926 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d91a6-f664-4da0-b42f-ef5b641172d4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:00.980636 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee11eae-133a-4eaa-96c2-56b80bc794a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:00.981269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11eae-133a-4eaa-96c2-56b80bc794a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:00.981549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11eae-133a-4eaa-96c2-56b80bc794a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:00.981820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee11eae-133a-4eaa-96c2-56b80bc794a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:00.991077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee11eae-133a-4eaa-96c2-56b80bc794a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:00.992494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee11eae-133a-4eaa-96c2-56b80bc794a8 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:01.001653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1436/2845] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:01.260853 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f7041-cc7b-477b-bae6-d3f2f0464fcb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:01.262413 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-736f7041-cc7b-477b-bae6-d3f2f0464fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:01.275125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f7041-cc7b-477b-bae6-d3f2f0464fcb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:01.279846 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:01.280702 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:01.280847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:01.281043 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] PATH_INFO: `/v3/projects/9184882505174fe29e1cdcc6512954be` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:01.282160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9184882505174fe29e1cdcc6512954be)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:01.284111 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:01.329754 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9184882505174fe29e1cdcc6512954be', 'request_id': 'req-ab9d7866-0176-4076-9836-9cc82a613dbe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.335367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9184882505174fe29e1cdcc6512954be', 'request_id': 'req-ab9d7866-0176-4076-9836-9cc82a613dbe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.341600 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9184882505174fe29e1cdcc6512954be', 'request_id': 'req-ab9d7866-0176-4076-9836-9cc82a613dbe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.354592 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] The token cache is being invalidate because project 9184882505174fe29e1cdcc6512954be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:01.354880 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.355526 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.357019 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1410/2846] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:01 2022] DELETE /identity/v3/projects/9184882505174fe29e1cdcc6512954be => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:01.361129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee11eae-133a-4eaa-96c2-56b80bc794a8 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:01.370621 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee11eae-133a-4eaa-96c2-56b80bc794a8 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:01.426331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:01.426884 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:01.427166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:01.427446 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] PATH_INFO: `/v3/users/75a9900e0e5b46f2b5e3a8a419c1fa11` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:01.428562 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a9900e0e5b46f2b5e3a8a419c1fa11)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:01.430566 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:01.475648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a9900e0e5b46f2b5e3a8a419c1fa11'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.487815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a9900e0e5b46f2b5e3a8a419c1fa11'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.489050 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a9900e0e5b46f2b5e3a8a419c1fa11'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.497862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a9900e0e5b46f2b5e3a8a419c1fa11'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.498685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a9900e0e5b46f2b5e3a8a419c1fa11'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.512593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1437/2847] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:01 2022] DELETE /identity/v3/users/75a9900e0e5b46f2b5e3a8a419c1fa11 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:10:01.780041 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:01.781608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:01.795542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d7866-0176-4076-9836-9cc82a613dbe admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:01.820256 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:01.860575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:01.861261 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:01.861497 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:01.861765 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] PATH_INFO: `/v3/projects/fd1ee615029a44ccbd9274d189208f1e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:01.862873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1ee615029a44ccbd9274d189208f1e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:01.865347 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:01.909692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1ee615029a44ccbd9274d189208f1e', 'request_id': 'req-db756bcf-52fe-46f3-aaa8-35e06106a49d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.915608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1ee615029a44ccbd9274d189208f1e', 'request_id': 'req-db756bcf-52fe-46f3-aaa8-35e06106a49d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.921658 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1ee615029a44ccbd9274d189208f1e', 'request_id': 'req-db756bcf-52fe-46f3-aaa8-35e06106a49d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.934141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] The token cache is being invalidate because project fd1ee615029a44ccbd9274d189208f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:01.934433 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.935053 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:01.936524 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1411/2848] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:01 2022] DELETE /identity/v3/projects/fd1ee615029a44ccbd9274d189208f1e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:01.940864 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:01.942397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:01.954712 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1ba3f-f6f0-4943-99a0-d49e4b265d0d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:01.979443 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:02.012653 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.013429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.013740 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.014147 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] PATH_INFO: `/v3/users/d2ba06d35e504a1996e8d587755b362a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.015269 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ba06d35e504a1996e8d587755b362a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.017202 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.061260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ba06d35e504a1996e8d587755b362a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.073580 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ba06d35e504a1996e8d587755b362a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.074236 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ba06d35e504a1996e8d587755b362a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.081330 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ba06d35e504a1996e8d587755b362a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.081963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c2aa42a0-1565-43a3-a0ad-339b9e1e6144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ba06d35e504a1996e8d587755b362a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.093944 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1438/2849] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:01 2022] DELETE /identity/v3/users/d2ba06d35e504a1996e8d587755b362a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:02.365548 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.367038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:02.380068 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756bcf-52fe-46f3-aaa8-35e06106a49d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.438847 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.439483 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.439764 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.440038 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] PATH_INFO: `/v3/projects/30ad4068e2bd4a2b85fe3e3878402b91` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.441354 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ad4068e2bd4a2b85fe3e3878402b91)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.443407 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.490442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ad4068e2bd4a2b85fe3e3878402b91', 'request_id': 'req-af00cf77-e977-4aee-b543-d2922ad4b41e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.494142 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:02.496517 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ad4068e2bd4a2b85fe3e3878402b91', 'request_id': 'req-af00cf77-e977-4aee-b543-d2922ad4b41e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.504349 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ad4068e2bd4a2b85fe3e3878402b91', 'request_id': 'req-af00cf77-e977-4aee-b543-d2922ad4b41e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.515744 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] The token cache is being invalidate because project 30ad4068e2bd4a2b85fe3e3878402b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:02.516034 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.516660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-af00cf77-e977-4aee-b543-d2922ad4b41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:02.518144 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1412/2850] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:02 2022] DELETE /identity/v3/projects/30ad4068e2bd4a2b85fe3e3878402b91 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:02.524558 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278853-e9ae-47b6-bd08-683ef7fe6a60 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.524847 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278853-e9ae-47b6-bd08-683ef7fe6a60 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.525164 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f278853-e9ae-47b6-bd08-683ef7fe6a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.544862 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8f278853-e9ae-47b6-bd08-683ef7fe6a60 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:02.546088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8f278853-e9ae-47b6-bd08-683ef7fe6a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:02.605273 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1439/2851] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:02.666763 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381facd6-d620-4c4c-a969-742ec65815d1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.667046 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381facd6-d620-4c4c-a969-742ec65815d1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.667322 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381facd6-d620-4c4c-a969-742ec65815d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.687367 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-381facd6-d620-4c4c-a969-742ec65815d1 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:02.688561 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-381facd6-d620-4c4c-a969-742ec65815d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:02.697023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1413/2852] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:02.701103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f278853-e9ae-47b6-bd08-683ef7fe6a60 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.711260 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f278853-e9ae-47b6-bd08-683ef7fe6a60 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.715754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.716347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.716624 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.716895 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.717569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:02.717871 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.719717 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.730934 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1440/2853] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:10:02.734914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381facd6-d620-4c4c-a969-742ec65815d1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.744012 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381facd6-d620-4c4c-a969-742ec65815d1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.748602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202b10-0582-4c96-bff1-cf0e24b105f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.749226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202b10-0582-4c96-bff1-cf0e24b105f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.749510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202b10-0582-4c96-bff1-cf0e24b105f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.749783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202b10-0582-4c96-bff1-cf0e24b105f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.750402 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a202b10-0582-4c96-bff1-cf0e24b105f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.752324 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a202b10-0582-4c96-bff1-cf0e24b105f3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.779599 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1414/2854] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:02.784099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.794429 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578a3b-13a6-411d-a8f2-9f8cf932d1e6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.824900 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:02.853509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94580e6-e404-4493-853f-7857da9b7d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.854107 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94580e6-e404-4493-853f-7857da9b7d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.854384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94580e6-e404-4493-853f-7857da9b7d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.854652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94580e6-e404-4493-853f-7857da9b7d00 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.855275 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94580e6-e404-4493-853f-7857da9b7d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.857188 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94580e6-e404-4493-853f-7857da9b7d00 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.878709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1441/2855] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:02 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:02.883335 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202b10-0582-4c96-bff1-cf0e24b105f3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.893633 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202b10-0582-4c96-bff1-cf0e24b105f3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.898195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4152-2ccf-4153-88e2-819b5be8d9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.898819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4152-2ccf-4153-88e2-819b5be8d9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.899099 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4152-2ccf-4153-88e2-819b5be8d9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.899369 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4152-2ccf-4153-88e2-819b5be8d9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.900001 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a4152-2ccf-4153-88e2-819b5be8d9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.901641 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a4152-2ccf-4153-88e2-819b5be8d9e9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.911883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1415/2856] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:02.915743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94580e6-e404-4493-853f-7857da9b7d00 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.925383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94580e6-e404-4493-853f-7857da9b7d00 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.930491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d5dbf-9d6e-4d74-90d0-ce58e54c84be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.931077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d5dbf-9d6e-4d74-90d0-ce58e54c84be admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.931359 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d5dbf-9d6e-4d74-90d0-ce58e54c84be admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.931634 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d5dbf-9d6e-4d74-90d0-ce58e54c84be admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.932264 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d5dbf-9d6e-4d74-90d0-ce58e54c84be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.933879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d5dbf-9d6e-4d74-90d0-ce58e54c84be admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.943457 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1442/2857] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:02.947359 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4152-2ccf-4153-88e2-819b5be8d9e9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:02.956960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4152-2ccf-4153-88e2-819b5be8d9e9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:02.962076 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c753d-4297-442c-825b-e4f249a607cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:02.962693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c753d-4297-442c-825b-e4f249a607cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:02.962970 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c753d-4297-442c-825b-e4f249a607cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:02.963239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c753d-4297-442c-825b-e4f249a607cc admin admin] PATH_INFO: `/v3/projects/03be9514824c4a52a8ab1c526ffb7c36/users/042585b6b5a44d3fbd73cc8a3c798bcf/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:02.977746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c753d-4297-442c-825b-e4f249a607cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=03be9514824c4a52a8ab1c526ffb7c36, user_id=042585b6b5a44d3fbd73cc8a3c798bcf, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:02.980330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c753d-4297-442c-825b-e4f249a607cc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:02.993240 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1416/2858] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:02 2022] PUT /identity/v3/projects/03be9514824c4a52a8ab1c526ffb7c36/users/042585b6b5a44d3fbd73cc8a3c798bcf/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:03.003999 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3c78a-636b-484c-8aee-fa44a074d238 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.004833 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3c78a-636b-484c-8aee-fa44a074d238 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.005148 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3c78a-636b-484c-8aee-fa44a074d238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.033487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-70e3c78a-636b-484c-8aee-fa44a074d238 None None] MFA Rules not processed for user `042585b6b5a44d3fbd73cc8a3c798bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:03.034814 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-70e3c78a-636b-484c-8aee-fa44a074d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:03.099876 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1443/2859] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:03.105003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c753d-4297-442c-825b-e4f249a607cc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.166900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c753d-4297-442c-825b-e4f249a607cc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.171563 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c5254-53ac-472c-8816-5c649423c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.172160 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c5254-53ac-472c-8816-5c649423c5ba admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.172442 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c5254-53ac-472c-8816-5c649423c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.172716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c5254-53ac-472c-8816-5c649423c5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.173380 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c5254-53ac-472c-8816-5c649423c5ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.175258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c5254-53ac-472c-8816-5c649423c5ba admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.200265 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1417/2860] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:03 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:03.204360 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3c78a-636b-484c-8aee-fa44a074d238 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.215525 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3c78a-636b-484c-8aee-fa44a074d238 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.269223 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6589a9-362b-487c-b884-53194c88969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.270680 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6589a9-362b-487c-b884-53194c88969e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.270963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6589a9-362b-487c-b884-53194c88969e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.271235 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6589a9-362b-487c-b884-53194c88969e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.271898 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6589a9-362b-487c-b884-53194c88969e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.273812 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6589a9-362b-487c-b884-53194c88969e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.294888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1444/2861] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:03 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:03.298816 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c5254-53ac-472c-8816-5c649423c5ba admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.308830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c5254-53ac-472c-8816-5c649423c5ba admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.313416 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee91af-adc1-45ee-9ec9-4facfa5f96ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.314003 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee91af-adc1-45ee-9ec9-4facfa5f96ff admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.314280 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee91af-adc1-45ee-9ec9-4facfa5f96ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.314549 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee91af-adc1-45ee-9ec9-4facfa5f96ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.315178 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee91af-adc1-45ee-9ec9-4facfa5f96ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.316758 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee91af-adc1-45ee-9ec9-4facfa5f96ff admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.327351 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1418/2862] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:03.331018 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6589a9-362b-487c-b884-53194c88969e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.341372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6589a9-362b-487c-b884-53194c88969e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.346182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230c105-a4be-4613-acaf-91e7ce126948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.346819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230c105-a4be-4613-acaf-91e7ce126948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.347099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230c105-a4be-4613-acaf-91e7ce126948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.347374 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230c105-a4be-4613-acaf-91e7ce126948 admin admin] PATH_INFO: `/v3/projects/374f29c771094157a600b6f0570a4775/users/3715ca9c940346cd941bce8f754bc49b/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.362328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230c105-a4be-4613-acaf-91e7ce126948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f29c771094157a600b6f0570a4775, user_id=3715ca9c940346cd941bce8f754bc49b, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.364956 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230c105-a4be-4613-acaf-91e7ce126948 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.377629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1445/2863] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:03 2022] PUT /identity/v3/projects/374f29c771094157a600b6f0570a4775/users/3715ca9c940346cd941bce8f754bc49b/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:03.381966 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee91af-adc1-45ee-9ec9-4facfa5f96ff admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.391940 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee91af-adc1-45ee-9ec9-4facfa5f96ff admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.438507 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:03.449263 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c495b5-1e80-480c-8d6b-067064365493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.449907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c495b5-1e80-480c-8d6b-067064365493 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.450190 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c495b5-1e80-480c-8d6b-067064365493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.450496 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c495b5-1e80-480c-8d6b-067064365493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.451137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c495b5-1e80-480c-8d6b-067064365493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.452766 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c495b5-1e80-480c-8d6b-067064365493 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.463336 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1419/2864] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:10:03.467465 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230c105-a4be-4613-acaf-91e7ce126948 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.477810 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230c105-a4be-4613-acaf-91e7ce126948 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.482427 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.483070 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.483347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.483618 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] PATH_INFO: `/v3/projects/374f29c771094157a600b6f0570a4775/users/3715ca9c940346cd941bce8f754bc49b/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.485527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374f29c771094157a600b6f0570a4775, user_id=3715ca9c940346cd941bce8f754bc49b, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.488122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.490332 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:03.499886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1446/2865] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:03 2022] PUT /identity/v3/projects/374f29c771094157a600b6f0570a4775/users/3715ca9c940346cd941bce8f754bc49b/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:03.511655 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182b796-243c-4cef-a933-e6932425dbfa None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.511935 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182b796-243c-4cef-a933-e6932425dbfa None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.512205 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182b796-243c-4cef-a933-e6932425dbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.539560 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c182b796-243c-4cef-a933-e6932425dbfa None None] MFA Rules not processed for user `3715ca9c940346cd941bce8f754bc49b`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:03.540676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c182b796-243c-4cef-a933-e6932425dbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:03.607301 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1420/2866] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:03 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:10:03.617949 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.619627 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:03.676266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31749b9d-6ac2-4217-b32f-ad8c85474376 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.679922 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684ac07-9659-4d4c-a21d-651ed2887144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.680515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684ac07-9659-4d4c-a21d-651ed2887144 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.680793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684ac07-9659-4d4c-a21d-651ed2887144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.681099 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684ac07-9659-4d4c-a21d-651ed2887144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.689888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684ac07-9659-4d4c-a21d-651ed2887144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.691310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684ac07-9659-4d4c-a21d-651ed2887144 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.701112 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1447/2867] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:03.776746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182b796-243c-4cef-a933-e6932425dbfa None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:03.786889 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182b796-243c-4cef-a933-e6932425dbfa None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:03.790596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52816626-4590-4cc7-b152-a64461ec1445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:03.791134 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816626-4590-4cc7-b152-a64461ec1445 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:03.791409 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816626-4590-4cc7-b152-a64461ec1445 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:03.791676 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52816626-4590-4cc7-b152-a64461ec1445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:03.850055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52816626-4590-4cc7-b152-a64461ec1445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:03.851492 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52816626-4590-4cc7-b152-a64461ec1445 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:03.860289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1421/2868] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:07.897815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684ac07-9659-4d4c-a21d-651ed2887144 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:07.961578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684ac07-9659-4d4c-a21d-651ed2887144 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:07.966161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:07.966779 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:07.967053 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:07.967321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] PATH_INFO: `/v3/users/042585b6b5a44d3fbd73cc8a3c798bcf` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:07.968417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=042585b6b5a44d3fbd73cc8a3c798bcf)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:07.970626 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.015418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042585b6b5a44d3fbd73cc8a3c798bcf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.027487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042585b6b5a44d3fbd73cc8a3c798bcf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.028137 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042585b6b5a44d3fbd73cc8a3c798bcf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.035283 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042585b6b5a44d3fbd73cc8a3c798bcf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.035891 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042585b6b5a44d3fbd73cc8a3c798bcf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.047713 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1448/2869] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:07 2022] DELETE /identity/v3/users/042585b6b5a44d3fbd73cc8a3c798bcf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:08.052128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2e72-213c-4207-a268-a792869e57ba None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.052610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2e72-213c-4207-a268-a792869e57ba None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.052714 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2e72-213c-4207-a268-a792869e57ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.072704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-211b2e72-213c-4207-a268-a792869e57ba None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:08.073934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-211b2e72-213c-4207-a268-a792869e57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:08.131513 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1422/2870] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:10:08.141120 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.142535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:08.160314 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:08.200606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8608cf-e52d-49d2-a739-96e148da8f3b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.204224 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db685c7-abb1-4be0-b77f-494de72239df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.204823 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db685c7-abb1-4be0-b77f-494de72239df service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.205140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db685c7-abb1-4be0-b77f-494de72239df service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.205417 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db685c7-abb1-4be0-b77f-494de72239df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.214910 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db685c7-abb1-4be0-b77f-494de72239df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.216331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db685c7-abb1-4be0-b77f-494de72239df service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.226313 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1449/2871] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:08.489287 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2e72-213c-4207-a268-a792869e57ba None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.490706 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-211b2e72-213c-4207-a268-a792869e57ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:08.502768 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b2e72-213c-4207-a268-a792869e57ba None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.507613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.508462 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.508745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.509054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] PATH_INFO: `/v3/projects/03be9514824c4a52a8ab1c526ffb7c36` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.510685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03be9514824c4a52a8ab1c526ffb7c36)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.513103 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.522737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:08.561559 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03be9514824c4a52a8ab1c526ffb7c36', 'request_id': 'req-25920a4d-2607-4b75-a325-7566c79dcb2a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.566994 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03be9514824c4a52a8ab1c526ffb7c36', 'request_id': 'req-25920a4d-2607-4b75-a325-7566c79dcb2a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.573040 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03be9514824c4a52a8ab1c526ffb7c36', 'request_id': 'req-25920a4d-2607-4b75-a325-7566c79dcb2a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.585737 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] The token cache is being invalidate because project 03be9514824c4a52a8ab1c526ffb7c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:08.586027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.586796 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.588746 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1423/2872] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:08 2022] DELETE /identity/v3/projects/03be9514824c4a52a8ab1c526ffb7c36 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:08.592508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db685c7-abb1-4be0-b77f-494de72239df service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:08.603095 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db685c7-abb1-4be0-b77f-494de72239df service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:08.661197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:08.661817 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:08.662092 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:08.662358 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] PATH_INFO: `/v3/users/3715ca9c940346cd941bce8f754bc49b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:08.663453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3715ca9c940346cd941bce8f754bc49b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:08.665381 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:08.710700 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3715ca9c940346cd941bce8f754bc49b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.722688 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3715ca9c940346cd941bce8f754bc49b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.723839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3715ca9c940346cd941bce8f754bc49b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.731026 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3715ca9c940346cd941bce8f754bc49b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.731685 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9957a6b-4618-4768-8e06-49653d3a62d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3715ca9c940346cd941bce8f754bc49b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:08.744312 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1450/2873] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:08 2022] DELETE /identity/v3/users/3715ca9c940346cd941bce8f754bc49b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:09.006807 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.008238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:09.021030 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25920a4d-2607-4b75-a325-7566c79dcb2a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.077049 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.077693 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.077945 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.078212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] PATH_INFO: `/v3/projects/374f29c771094157a600b6f0570a4775` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.079303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=374f29c771094157a600b6f0570a4775)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.081207 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.126176 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374f29c771094157a600b6f0570a4775', 'request_id': 'req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:09.132157 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374f29c771094157a600b6f0570a4775', 'request_id': 'req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:09.138135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374f29c771094157a600b6f0570a4775', 'request_id': 'req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:09.149938 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] The token cache is being invalidate because project 374f29c771094157a600b6f0570a4775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:09.150834 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:09.151542 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3f900d01-b8e5-42c7-b325-0765d3ce0c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:09.153058 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1424/2874] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:09 2022] DELETE /identity/v3/projects/374f29c771094157a600b6f0570a4775 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:09.157875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f75c-7849-41b4-9aa1-c1570e9a3419 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.158326 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f75c-7849-41b4-9aa1-c1570e9a3419 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.158445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f75c-7849-41b4-9aa1-c1570e9a3419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.178199 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ed60f75c-7849-41b4-9aa1-c1570e9a3419 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:09.179376 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ed60f75c-7849-41b4-9aa1-c1570e9a3419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:09.210837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:09.238348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1451/2875] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:10:09.246683 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ab6a-9b4c-4131-8c96-69db6c61638e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.246972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ab6a-9b4c-4131-8c96-69db6c61638e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.247250 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ab6a-9b4c-4131-8c96-69db6c61638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.267126 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b220ab6a-9b4c-4131-8c96-69db6c61638e None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:09.268321 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b220ab6a-9b4c-4131-8c96-69db6c61638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:09.276175 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1425/2876] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:09.280317 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f75c-7849-41b4-9aa1-c1570e9a3419 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.289820 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60f75c-7849-41b4-9aa1-c1570e9a3419 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.294318 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.294902 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.295176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.295444 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.296077 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:09.296372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.297988 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.309596 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1452/2877] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:10:09.313668 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220ab6a-9b4c-4131-8c96-69db6c61638e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.323575 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220ab6a-9b4c-4131-8c96-69db6c61638e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.328288 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95b21-e125-40be-9508-0c90327a5c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.328884 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95b21-e125-40be-9508-0c90327a5c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.329221 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95b21-e125-40be-9508-0c90327a5c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.329608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95b21-e125-40be-9508-0c90327a5c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.330252 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95b21-e125-40be-9508-0c90327a5c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.332141 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95b21-e125-40be-9508-0c90327a5c01 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.353004 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:09.360958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1426/2878] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:09 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:10:09.365491 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.375170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80db6d-8892-4896-9acb-d4a0b07fde8b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.429683 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6186f92-76d9-4900-9ce0-2b048440eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.430211 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6186f92-76d9-4900-9ce0-2b048440eeae admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.430493 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6186f92-76d9-4900-9ce0-2b048440eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.430762 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6186f92-76d9-4900-9ce0-2b048440eeae admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.431384 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6186f92-76d9-4900-9ce0-2b048440eeae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.433300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6186f92-76d9-4900-9ce0-2b048440eeae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.454134 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1453/2879] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:09 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:09.458206 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95b21-e125-40be-9508-0c90327a5c01 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.468371 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95b21-e125-40be-9508-0c90327a5c01 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.473787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27179b0f-db95-4498-9b35-3f38d0426124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.474377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27179b0f-db95-4498-9b35-3f38d0426124 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.474656 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27179b0f-db95-4498-9b35-3f38d0426124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.474923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27179b0f-db95-4498-9b35-3f38d0426124 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.475554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27179b0f-db95-4498-9b35-3f38d0426124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.477154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27179b0f-db95-4498-9b35-3f38d0426124 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.486855 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1427/2880] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 10 12:10:09.491055 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6186f92-76d9-4900-9ce0-2b048440eeae admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.500888 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6186f92-76d9-4900-9ce0-2b048440eeae admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.505532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87115d6-d8f3-464c-9a0a-b750967a71f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.506119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87115d6-d8f3-464c-9a0a-b750967a71f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.506400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87115d6-d8f3-464c-9a0a-b750967a71f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.506681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87115d6-d8f3-464c-9a0a-b750967a71f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.507311 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87115d6-d8f3-464c-9a0a-b750967a71f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.508877 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87115d6-d8f3-464c-9a0a-b750967a71f6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.519118 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1454/2881] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:09.523177 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27179b0f-db95-4498-9b35-3f38d0426124 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.532715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27179b0f-db95-4498-9b35-3f38d0426124 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.538649 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d6e69-b8f5-41f8-be1d-5e24b5701450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.539297 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d6e69-b8f5-41f8-be1d-5e24b5701450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.539579 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d6e69-b8f5-41f8-be1d-5e24b5701450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.539854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d6e69-b8f5-41f8-be1d-5e24b5701450 admin admin] PATH_INFO: `/v3/projects/6a02e4a1acf44a149d4cfc895d65e9e4/users/d028e039676a4b758c801358715ccf6d/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.554921 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d6e69-b8f5-41f8-be1d-5e24b5701450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a02e4a1acf44a149d4cfc895d65e9e4, user_id=d028e039676a4b758c801358715ccf6d, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.557601 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d6e69-b8f5-41f8-be1d-5e24b5701450 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.570198 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1428/2882] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:09 2022] PUT /identity/v3/projects/6a02e4a1acf44a149d4cfc895d65e9e4/users/d028e039676a4b758c801358715ccf6d/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:09.580486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8592ab-c433-4d20-8b49-fd053b3a0d6a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.580772 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8592ab-c433-4d20-8b49-fd053b3a0d6a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.581088 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8592ab-c433-4d20-8b49-fd053b3a0d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.610702 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6d8592ab-c433-4d20-8b49-fd053b3a0d6a None None] MFA Rules not processed for user `d028e039676a4b758c801358715ccf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:09.611921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6d8592ab-c433-4d20-8b49-fd053b3a0d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:09.675025 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1455/2883] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:09.680258 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d6e69-b8f5-41f8-be1d-5e24b5701450 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.740802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d6e69-b8f5-41f8-be1d-5e24b5701450 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.745689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aeb9ef-1c3a-4bbe-ae07-d866b06c5bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.746289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeb9ef-1c3a-4bbe-ae07-d866b06c5bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.746571 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeb9ef-1c3a-4bbe-ae07-d866b06c5bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.746875 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aeb9ef-1c3a-4bbe-ae07-d866b06c5bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.747511 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aeb9ef-1c3a-4bbe-ae07-d866b06c5bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.749438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aeb9ef-1c3a-4bbe-ae07-d866b06c5bd3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.775196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1429/2884] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:09 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:09.779372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8592ab-c433-4d20-8b49-fd053b3a0d6a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.790476 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8592ab-c433-4d20-8b49-fd053b3a0d6a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.819415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:09.847103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394412c4-387f-482f-9d48-5cce6d9efd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.847709 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394412c4-387f-482f-9d48-5cce6d9efd0e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.847987 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394412c4-387f-482f-9d48-5cce6d9efd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.848837 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394412c4-387f-482f-9d48-5cce6d9efd0e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.849518 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394412c4-387f-482f-9d48-5cce6d9efd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.851412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394412c4-387f-482f-9d48-5cce6d9efd0e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.871718 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1456/2885] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:09 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:09.875809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aeb9ef-1c3a-4bbe-ae07-d866b06c5bd3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.886122 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aeb9ef-1c3a-4bbe-ae07-d866b06c5bd3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.891034 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f6e4a-726b-4715-a0ef-5fbbbe8fd671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.891631 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f6e4a-726b-4715-a0ef-5fbbbe8fd671 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.891911 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f6e4a-726b-4715-a0ef-5fbbbe8fd671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.892184 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f6e4a-726b-4715-a0ef-5fbbbe8fd671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.892823 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f6e4a-726b-4715-a0ef-5fbbbe8fd671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.895955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f6e4a-726b-4715-a0ef-5fbbbe8fd671 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.906381 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1430/2886] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:09.910361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394412c4-387f-482f-9d48-5cce6d9efd0e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.920578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394412c4-387f-482f-9d48-5cce6d9efd0e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:09.925128 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c76cd-e63e-4754-b71b-e548d65031aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:09.925768 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c76cd-e63e-4754-b71b-e548d65031aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:09.926049 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c76cd-e63e-4754-b71b-e548d65031aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:09.926352 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c76cd-e63e-4754-b71b-e548d65031aa admin admin] PATH_INFO: `/v3/projects/e57bf4ff04e24406a87c5af469a63219/users/ce4c56d8ad45465c98aa1c7ef130d0af/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:09.945976 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c76cd-e63e-4754-b71b-e548d65031aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57bf4ff04e24406a87c5af469a63219, user_id=ce4c56d8ad45465c98aa1c7ef130d0af, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:09.948500 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c76cd-e63e-4754-b71b-e548d65031aa admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:09.961649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1457/2887] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:09 2022] PUT /identity/v3/projects/e57bf4ff04e24406a87c5af469a63219/users/ce4c56d8ad45465c98aa1c7ef130d0af/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:10:09.965652 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f6e4a-726b-4715-a0ef-5fbbbe8fd671 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:09.975898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f6e4a-726b-4715-a0ef-5fbbbe8fd671 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.030814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e29f5-5dd9-4db1-b79d-0d02cbae26d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.031414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e29f5-5dd9-4db1-b79d-0d02cbae26d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.031692 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e29f5-5dd9-4db1-b79d-0d02cbae26d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.031958 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e29f5-5dd9-4db1-b79d-0d02cbae26d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.032602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e29f5-5dd9-4db1-b79d-0d02cbae26d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.034191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e29f5-5dd9-4db1-b79d-0d02cbae26d7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.043554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1431/2888] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:10.047669 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c76cd-e63e-4754-b71b-e548d65031aa admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.058445 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c76cd-e63e-4754-b71b-e548d65031aa admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.063014 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.063662 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.063938 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.064207 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] PATH_INFO: `/v3/projects/e57bf4ff04e24406a87c5af469a63219/users/ce4c56d8ad45465c98aa1c7ef130d0af/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.066122 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57bf4ff04e24406a87c5af469a63219, user_id=ce4c56d8ad45465c98aa1c7ef130d0af, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.069351 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.079340 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1458/2889] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:10 2022] PUT /identity/v3/projects/e57bf4ff04e24406a87c5af469a63219/users/ce4c56d8ad45465c98aa1c7ef130d0af/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:10.090582 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd781a-cb09-4455-a6dc-5d5a5d66ed00 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.091080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd781a-cb09-4455-a6dc-5d5a5d66ed00 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.091195 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd781a-cb09-4455-a6dc-5d5a5d66ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.119307 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a6fd781a-cb09-4455-a6dc-5d5a5d66ed00 None None] MFA Rules not processed for user `ce4c56d8ad45465c98aa1c7ef130d0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:10.120510 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a6fd781a-cb09-4455-a6dc-5d5a5d66ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:10.139720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:10.189035 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1432/2890] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:10.199553 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.201218 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:10.257937 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cacb71-470c-4c46-b920-436a123fed98 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.261815 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838d166-3fb5-494c-b811-db0b084535f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.262414 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d166-3fb5-494c-b811-db0b084535f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.262689 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d166-3fb5-494c-b811-db0b084535f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.262958 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838d166-3fb5-494c-b811-db0b084535f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.271887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838d166-3fb5-494c-b811-db0b084535f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.273346 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838d166-3fb5-494c-b811-db0b084535f6 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.282557 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1459/2891] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:10.416570 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd781a-cb09-4455-a6dc-5d5a5d66ed00 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.477387 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd781a-cb09-4455-a6dc-5d5a5d66ed00 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.481776 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.482390 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.482665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.482934 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] PATH_INFO: `/v3/users/d028e039676a4b758c801358715ccf6d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.484023 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d028e039676a4b758c801358715ccf6d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.485952 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.530196 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd028e039676a4b758c801358715ccf6d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:10.542438 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd028e039676a4b758c801358715ccf6d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:10.543092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd028e039676a4b758c801358715ccf6d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:10.550139 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd028e039676a4b758c801358715ccf6d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:10.550760 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd028e039676a4b758c801358715ccf6d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:10.563610 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1433/2892] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:10 2022] DELETE /identity/v3/users/d028e039676a4b758c801358715ccf6d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:10.568051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26799cc-eef2-4911-942e-ada0e75a8bcf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.568334 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26799cc-eef2-4911-942e-ada0e75a8bcf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.568606 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26799cc-eef2-4911-942e-ada0e75a8bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.587503 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c26799cc-eef2-4911-942e-ada0e75a8bcf None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:10.588699 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c26799cc-eef2-4911-942e-ada0e75a8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:10.645724 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1460/2893] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:10.655330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:10.656715 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:10.698955 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:10.715553 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a384f-3c20-4cf1-bbfb-8814a933c305 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:10.719291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d4362-693b-4e9b-97db-ec0332443d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:10.720155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d4362-693b-4e9b-97db-ec0332443d8a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:10.720436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d4362-693b-4e9b-97db-ec0332443d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:10.720708 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d4362-693b-4e9b-97db-ec0332443d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:10.729792 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d4362-693b-4e9b-97db-ec0332443d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:10.731154 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d4362-693b-4e9b-97db-ec0332443d8a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:10.741062 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1434/2894] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:11.001361 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26799cc-eef2-4911-942e-ada0e75a8bcf None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:11.002829 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c26799cc-eef2-4911-942e-ada0e75a8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:11.016759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26799cc-eef2-4911-942e-ada0e75a8bcf None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:11.022170 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:11.022843 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.023103 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.023383 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] PATH_INFO: `/v3/projects/6a02e4a1acf44a149d4cfc895d65e9e4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.024501 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a02e4a1acf44a149d4cfc895d65e9e4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:11.026474 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:11.050941 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:11.073690 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a02e4a1acf44a149d4cfc895d65e9e4', 'request_id': 'req-7370001d-3c43-4dae-8c63-a07bea2ae8ce'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.079328 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a02e4a1acf44a149d4cfc895d65e9e4', 'request_id': 'req-7370001d-3c43-4dae-8c63-a07bea2ae8ce'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.085404 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a02e4a1acf44a149d4cfc895d65e9e4', 'request_id': 'req-7370001d-3c43-4dae-8c63-a07bea2ae8ce'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.097597 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] The token cache is being invalidate because project 6a02e4a1acf44a149d4cfc895d65e9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:11.097887 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.099017 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.100458 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1461/2895] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:11 2022] DELETE /identity/v3/projects/6a02e4a1acf44a149d4cfc895d65e9e4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:11.104476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d4362-693b-4e9b-97db-ec0332443d8a service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:11.114812 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d4362-693b-4e9b-97db-ec0332443d8a service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:11.169598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:11.170219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.170502 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.170773 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] PATH_INFO: `/v3/users/ce4c56d8ad45465c98aa1c7ef130d0af` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.171872 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4c56d8ad45465c98aa1c7ef130d0af)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:11.173810 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:11.218432 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4c56d8ad45465c98aa1c7ef130d0af'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.230165 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4c56d8ad45465c98aa1c7ef130d0af'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.230809 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4c56d8ad45465c98aa1c7ef130d0af'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.237700 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4c56d8ad45465c98aa1c7ef130d0af'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.238309 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-5acac8d9-1d59-46c4-976a-a4cd723b30d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4c56d8ad45465c98aa1c7ef130d0af'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.250699 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1435/2896] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:11 2022] DELETE /identity/v3/users/ce4c56d8ad45465c98aa1c7ef130d0af => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:10:11.522668 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:11.524245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:11.537770 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370001d-3c43-4dae-8c63-a07bea2ae8ce admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:11.594613 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:11.595531 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.595806 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.596075 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] PATH_INFO: `/v3/projects/e57bf4ff04e24406a87c5af469a63219` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.597257 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57bf4ff04e24406a87c5af469a63219)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:11.599671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:11.648671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57bf4ff04e24406a87c5af469a63219', 'request_id': 'req-1cf032d4-fd01-4561-a84e-6b7827b75685'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.654356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57bf4ff04e24406a87c5af469a63219', 'request_id': 'req-1cf032d4-fd01-4561-a84e-6b7827b75685'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.660678 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57bf4ff04e24406a87c5af469a63219', 'request_id': 'req-1cf032d4-fd01-4561-a84e-6b7827b75685'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.674338 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] The token cache is being invalidate because project e57bf4ff04e24406a87c5af469a63219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:11.674623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.675261 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1cf032d4-fd01-4561-a84e-6b7827b75685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:11.677304 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1462/2897] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:11 2022] DELETE /identity/v3/projects/e57bf4ff04e24406a87c5af469a63219 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:11.682159 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f29a3-e0f5-4d28-8ed9-2f74e237c526 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.682443 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f29a3-e0f5-4d28-8ed9-2f74e237c526 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.682713 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f29a3-e0f5-4d28-8ed9-2f74e237c526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.702233 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-290f29a3-e0f5-4d28-8ed9-2f74e237c526 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:11.703404 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-290f29a3-e0f5-4d28-8ed9-2f74e237c526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:11.753194 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:11.763113 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1436/2898] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:11.770511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd91ad-2bbc-43cb-bd65-d11897514398 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.770793 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd91ad-2bbc-43cb-bd65-d11897514398 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.771094 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd91ad-2bbc-43cb-bd65-d11897514398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.790654 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6fbd91ad-2bbc-43cb-bd65-d11897514398 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:11.791827 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6fbd91ad-2bbc-43cb-bd65-d11897514398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:11.799527 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1463/2899] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:11.804589 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f29a3-e0f5-4d28-8ed9-2f74e237c526 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:11.814523 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f29a3-e0f5-4d28-8ed9-2f74e237c526 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:11.819179 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:11.819774 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.820054 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.820327 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.820998 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:11.821303 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:11.822895 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:11.834230 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1437/2900] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 10 12:10:11.838484 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd91ad-2bbc-43cb-bd65-d11897514398 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:11.847771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd91ad-2bbc-43cb-bd65-d11897514398 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:11.852912 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33095d-e029-489c-b767-ed6d2804f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:11.853535 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33095d-e029-489c-b767-ed6d2804f578 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.853809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33095d-e029-489c-b767-ed6d2804f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.854105 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33095d-e029-489c-b767-ed6d2804f578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.854714 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33095d-e029-489c-b767-ed6d2804f578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:11.856593 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33095d-e029-489c-b767-ed6d2804f578 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:11.882960 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1464/2901] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:11 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:11.887026 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:11.897245 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94325ca-6a43-4f53-94dd-455a8c9351c9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:11.954356 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dde8c7-2cb6-49d4-a9a5-91295fe3bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:11.954969 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde8c7-2cb6-49d4-a9a5-91295fe3bcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:11.955255 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde8c7-2cb6-49d4-a9a5-91295fe3bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:11.955651 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dde8c7-2cb6-49d4-a9a5-91295fe3bcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:11.956277 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dde8c7-2cb6-49d4-a9a5-91295fe3bcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:11.958780 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dde8c7-2cb6-49d4-a9a5-91295fe3bcf8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:11.981044 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1438/2902] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:11 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:11.985255 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33095d-e029-489c-b767-ed6d2804f578 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:11.996411 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33095d-e029-489c-b767-ed6d2804f578 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:12.000946 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751835-cdc5-4d03-8a56-7adf32f65062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:12.001707 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751835-cdc5-4d03-8a56-7adf32f65062 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:12.002021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751835-cdc5-4d03-8a56-7adf32f65062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:12.002295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751835-cdc5-4d03-8a56-7adf32f65062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:12.002930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f751835-cdc5-4d03-8a56-7adf32f65062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:12.004514 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f751835-cdc5-4d03-8a56-7adf32f65062 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:12.015058 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1465/2903] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:12.019025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dde8c7-2cb6-49d4-a9a5-91295fe3bcf8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:12.029169 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dde8c7-2cb6-49d4-a9a5-91295fe3bcf8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:12.033802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eace5e-9b3b-4c10-a17e-a441aedc2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:12.034383 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eace5e-9b3b-4c10-a17e-a441aedc2218 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:12.034660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eace5e-9b3b-4c10-a17e-a441aedc2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:12.034929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eace5e-9b3b-4c10-a17e-a441aedc2218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:12.035612 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eace5e-9b3b-4c10-a17e-a441aedc2218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:12.037219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eace5e-9b3b-4c10-a17e-a441aedc2218 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:12.047598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1439/2904] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:12.052089 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751835-cdc5-4d03-8a56-7adf32f65062 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:12.057051 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:12.063433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751835-cdc5-4d03-8a56-7adf32f65062 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:12.069652 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:12.070300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:12.070578 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:12.070850 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] PATH_INFO: `/v3/projects/8e9f2034d36e467fa44f2f7f28f29316/users/75509472d67b45ebbfc67b1fdac413d0/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:12.085040 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9f2034d36e467fa44f2f7f28f29316, user_id=75509472d67b45ebbfc67b1fdac413d0, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:12.087664 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:12.100322 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1466/2905] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:12 2022] PUT /identity/v3/projects/8e9f2034d36e467fa44f2f7f28f29316/users/75509472d67b45ebbfc67b1fdac413d0/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:12.105420 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b0540-747b-466c-8ca8-0c58f3236267 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:12.105937 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b0540-747b-466c-8ca8-0c58f3236267 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:12.106071 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b0540-747b-466c-8ca8-0c58f3236267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:12.126325 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-746b0540-747b-466c-8ca8-0c58f3236267 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:12.127516 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-746b0540-747b-466c-8ca8-0c58f3236267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:12.184554 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1440/2906] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:12.194792 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:12.196494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:12.251831 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc173a-60d2-4fc9-b90b-bd83698fc2c4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:12.256217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da08e2-9abb-467b-bbdd-736d3ebe7c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:12.256841 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da08e2-9abb-467b-bbdd-736d3ebe7c3a service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:12.257151 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da08e2-9abb-467b-bbdd-736d3ebe7c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:12.257424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da08e2-9abb-467b-bbdd-736d3ebe7c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:12.266156 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da08e2-9abb-467b-bbdd-736d3ebe7c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:12.267569 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da08e2-9abb-467b-bbdd-736d3ebe7c3a service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:12.276576 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1467/2907] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:12.879691 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8064e2-5524-4ae3-b5ef-f2923ca1e330 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:12.880520 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8064e2-5524-4ae3-b5ef-f2923ca1e330 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:12.880798 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8064e2-5524-4ae3-b5ef-f2923ca1e330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:12.910435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1d8064e2-5524-4ae3-b5ef-f2923ca1e330 None None] MFA Rules not processed for user `75509472d67b45ebbfc67b1fdac413d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:12.911814 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1d8064e2-5524-4ae3-b5ef-f2923ca1e330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:12.969783 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:12.980088 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1441/2908] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:12.984754 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da08e2-9abb-467b-bbdd-736d3ebe7c3a service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:12.994875 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da08e2-9abb-467b-bbdd-736d3ebe7c3a service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:13.000795 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93591351-6fe3-46af-8a5b-23605923fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:13.001489 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93591351-6fe3-46af-8a5b-23605923fa8d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.001771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93591351-6fe3-46af-8a5b-23605923fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.002047 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93591351-6fe3-46af-8a5b-23605923fa8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.002681 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93591351-6fe3-46af-8a5b-23605923fa8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:13.004581 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93591351-6fe3-46af-8a5b-23605923fa8d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:13.032536 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1468/2909] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:12 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:13.036645 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8064e2-5524-4ae3-b5ef-f2923ca1e330 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:13.047435 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8064e2-5524-4ae3-b5ef-f2923ca1e330 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:13.105638 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee00b-8172-4766-8737-00c8f09d018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:13.106289 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee00b-8172-4766-8737-00c8f09d018c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.106441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee00b-8172-4766-8737-00c8f09d018c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.106711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ee00b-8172-4766-8737-00c8f09d018c admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.107345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ee00b-8172-4766-8737-00c8f09d018c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:13.109273 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ee00b-8172-4766-8737-00c8f09d018c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:13.130534 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1442/2910] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:13 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:10:13.134643 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93591351-6fe3-46af-8a5b-23605923fa8d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:13.144928 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93591351-6fe3-46af-8a5b-23605923fa8d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:13.149532 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1359a-2c23-47f4-9769-986a5a1d1fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:13.150117 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1359a-2c23-47f4-9769-986a5a1d1fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.150397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1359a-2c23-47f4-9769-986a5a1d1fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.150667 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1359a-2c23-47f4-9769-986a5a1d1fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.151295 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1359a-2c23-47f4-9769-986a5a1d1fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:13.152886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1359a-2c23-47f4-9769-986a5a1d1fe7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:13.164631 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1469/2911] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:13.168608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee00b-8172-4766-8737-00c8f09d018c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:13.178900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ee00b-8172-4766-8737-00c8f09d018c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:13.183395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b8a5d-6ada-4049-bb3d-9dee6ad07ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:13.184025 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b8a5d-6ada-4049-bb3d-9dee6ad07ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.184300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b8a5d-6ada-4049-bb3d-9dee6ad07ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.184569 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b8a5d-6ada-4049-bb3d-9dee6ad07ac2 admin admin] PATH_INFO: `/v3/projects/7cbd87280f384d9f9b3d32a1d14c8a2c/users/91a3dbd0e16041b78f8524fb8c38f808/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.198976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b8a5d-6ada-4049-bb3d-9dee6ad07ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbd87280f384d9f9b3d32a1d14c8a2c, user_id=91a3dbd0e16041b78f8524fb8c38f808, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:13.201686 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b8a5d-6ada-4049-bb3d-9dee6ad07ac2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:13.214238 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1443/2912] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:13 2022] PUT /identity/v3/projects/7cbd87280f384d9f9b3d32a1d14c8a2c/users/91a3dbd0e16041b78f8524fb8c38f808/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:13.218153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1359a-2c23-47f4-9769-986a5a1d1fe7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:13.228641 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1359a-2c23-47f4-9769-986a5a1d1fe7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:13.282808 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef4bb-01a6-4b78-9a6c-7070102d97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:13.283412 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef4bb-01a6-4b78-9a6c-7070102d97d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.283692 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef4bb-01a6-4b78-9a6c-7070102d97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.283963 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef4bb-01a6-4b78-9a6c-7070102d97d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.284590 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef4bb-01a6-4b78-9a6c-7070102d97d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:13.286756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef4bb-01a6-4b78-9a6c-7070102d97d6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:13.296166 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1470/2913] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:13.300294 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b8a5d-6ada-4049-bb3d-9dee6ad07ac2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:13.311229 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b8a5d-6ada-4049-bb3d-9dee6ad07ac2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:13.315959 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a72b4-d6d3-4a25-8446-ba33ef863478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:13.316608 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a72b4-d6d3-4a25-8446-ba33ef863478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.316873 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a72b4-d6d3-4a25-8446-ba33ef863478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.317228 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a72b4-d6d3-4a25-8446-ba33ef863478 admin admin] PATH_INFO: `/v3/projects/7cbd87280f384d9f9b3d32a1d14c8a2c/users/91a3dbd0e16041b78f8524fb8c38f808/roles/1f1b5ca5262b4535b5bb55f915b2f1b9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.319120 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a72b4-d6d3-4a25-8446-ba33ef863478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbd87280f384d9f9b3d32a1d14c8a2c, user_id=91a3dbd0e16041b78f8524fb8c38f808, role_id=1f1b5ca5262b4535b5bb55f915b2f1b9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:13.321761 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a72b4-d6d3-4a25-8446-ba33ef863478 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:13.331907 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1444/2914] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:13 2022] PUT /identity/v3/projects/7cbd87280f384d9f9b3d32a1d14c8a2c/users/91a3dbd0e16041b78f8524fb8c38f808/roles/1f1b5ca5262b4535b5bb55f915b2f1b9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:13.966397 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54110b-bc6e-415c-b4c8-29dee9e81cde None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:13.966753 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54110b-bc6e-415c-b4c8-29dee9e81cde None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:13.967183 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54110b-bc6e-415c-b4c8-29dee9e81cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:13.995886 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3f54110b-bc6e-415c-b4c8-29dee9e81cde None None] MFA Rules not processed for user `91a3dbd0e16041b78f8524fb8c38f808`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:13.997259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3f54110b-bc6e-415c-b4c8-29dee9e81cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.031415 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:14.068424 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1471/2915] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:14.078788 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3a7a-a5e3-4329-a94f-30dd99c087df None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:14.079072 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3a7a-a5e3-4329-a94f-30dd99c087df None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:14.079364 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3a7a-a5e3-4329-a94f-30dd99c087df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:14.098728 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6f0f3a7a-a5e3-4329-a94f-30dd99c087df None None] MFA Rules not processed for user `75509472d67b45ebbfc67b1fdac413d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:14.099923 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6f0f3a7a-a5e3-4329-a94f-30dd99c087df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.154080 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1445/2916] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:14.167853 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54110b-bc6e-415c-b4c8-29dee9e81cde None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:14.169366 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3f54110b-bc6e-415c-b4c8-29dee9e81cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.267278 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54110b-bc6e-415c-b4c8-29dee9e81cde None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:14.272720 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:14.273339 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:14.273644 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:14.273915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:14.281623 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:14.283176 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:14.291670 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1472/2917] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:14.323854 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f3a7a-a5e3-4329-a94f-30dd99c087df None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:14.325264 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6f0f3a7a-a5e3-4329-a94f-30dd99c087df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.381002 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f3a7a-a5e3-4329-a94f-30dd99c087df None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:14.384588 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4becd85ee7bb4920996dfe7b919aaa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:14.385222 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:14.385530 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:14.385802 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:14.387504 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.398295 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:14.400927 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:14.402741 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:14.414687 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1446/2918] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:14.927930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:14.929418 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:14.942580 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:14.944143 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:15.001830 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22e5da-df50-42cb-95d7-a58c67980033 service glance] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:15.005777 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:15.006385 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:15.006666 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:15.006936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:15.008690 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:15.009249 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823c58-cae1-465e-ada1-3a833aa32a31 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:15.014421 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:15.015028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:15.015310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:15.015582 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:15.017301 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:15.022988 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:15.024484 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:15.029365 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:15.030952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:15.035615 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1447/2919] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 10 12:10:15.040921 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1473/2920] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:17.007441 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:17.016197 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec49f74-a519-4c54-8d4d-b0b5819ee955 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:17.019929 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:17.021180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:17.021463 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:17.021732 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:17.023460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:17.034268 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:17.035672 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:17.044135 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1448/2921] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:17.682839 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:17.696751 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f6de7-b100-40d8-8e3f-d001fc42d6fa service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:17.702930 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:17.703549 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:17.703851 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:17.704542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:17.706435 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:17.720217 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:17.722068 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:17.733347 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1474/2922] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:22.252191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:22.253781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:22.271010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5b60a-3871-4ebe-9777-8071dae45735 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:22.276456 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa51dcbe21f04f24887beb458edb1dce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:22.277083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:22.277363 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:22.277630 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:22.279330 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:22.291845 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:22.293430 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:22.304883 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1449/2923] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:26.064671 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:26.066205 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:26.072079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:26.121622 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36b71-8259-4743-a5b8-ed929dccbf96 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:26.125153 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b44b4-456a-471a-b5ff-45ffbe2b8ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:26.125743 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b44b4-456a-471a-b5ff-45ffbe2b8ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:26.126021 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b44b4-456a-471a-b5ff-45ffbe2b8ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:26.126290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b44b4-456a-471a-b5ff-45ffbe2b8ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:26.134948 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b44b4-456a-471a-b5ff-45ffbe2b8ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:26.136356 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b44b4-456a-471a-b5ff-45ffbe2b8ec0 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:26.145401 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1475/2924] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:32.299577 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=40 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:36.141400 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=24 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:45.285423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:45.286819 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:45.301008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0327bc-9604-49d4-9b9a-91c2f82a5ce9 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:45.305905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:45.306500 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:45.306778 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:45.307050 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:45.308738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:45.320382 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:45.322602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:45.333032 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1450/2925] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:45.856710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b44b4-456a-471a-b5ff-45ffbe2b8ec0 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:45.917323 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b44b4-456a-471a-b5ff-45ffbe2b8ec0 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:45.921756 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:45.922372 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:45.922648 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:45.922915 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] PATH_INFO: `/v3/users/75509472d67b45ebbfc67b1fdac413d0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:45.924007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] RBAC: Authorizing `identity:delete_user(user_id=75509472d67b45ebbfc67b1fdac413d0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:45.926020 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:45.972494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75509472d67b45ebbfc67b1fdac413d0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:45.984252 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75509472d67b45ebbfc67b1fdac413d0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:45.985084 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75509472d67b45ebbfc67b1fdac413d0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:45.993679 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75509472d67b45ebbfc67b1fdac413d0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:45.994290 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75509472d67b45ebbfc67b1fdac413d0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.006348 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1476/2926] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:45 2022] DELETE /identity/v3/users/75509472d67b45ebbfc67b1fdac413d0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:46.175772 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:46.187092 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b43806-763b-4cfd-ba1e-864a73e52b29 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:46.245943 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:46.246573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.246852 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.247125 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] PATH_INFO: `/v3/projects/8e9f2034d36e467fa44f2f7f28f29316` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.248226 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9f2034d36e467fa44f2f7f28f29316)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:46.250155 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:46.297452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9f2034d36e467fa44f2f7f28f29316', 'request_id': 'req-28c29f85-bdbb-4e19-8564-59c77d2464a0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.302787 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9f2034d36e467fa44f2f7f28f29316', 'request_id': 'req-28c29f85-bdbb-4e19-8564-59c77d2464a0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.309509 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9f2034d36e467fa44f2f7f28f29316', 'request_id': 'req-28c29f85-bdbb-4e19-8564-59c77d2464a0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.321724 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] The token cache is being invalidate because project 8e9f2034d36e467fa44f2f7f28f29316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:46.322010 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.322738 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.324247 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1451/2927] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:46 2022] DELETE /identity/v3/projects/8e9f2034d36e467fa44f2f7f28f29316 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 10 12:10:46.328310 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:46.329794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:46.342587 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652e44-422c-41c8-85e7-eb5885bc760e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:46.397321 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:46.397879 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.398159 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.398433 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] PATH_INFO: `/v3/users/91a3dbd0e16041b78f8524fb8c38f808` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.399546 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a3dbd0e16041b78f8524fb8c38f808)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:46.401486 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:46.422515 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:46.446924 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a3dbd0e16041b78f8524fb8c38f808'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.458765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a3dbd0e16041b78f8524fb8c38f808'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.459410 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a3dbd0e16041b78f8524fb8c38f808'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.467857 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a3dbd0e16041b78f8524fb8c38f808'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.468523 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0a5439b-06ca-4e78-9158-3f2f5b4f693e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a3dbd0e16041b78f8524fb8c38f808'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.481498 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1477/2928] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:10:46 2022] DELETE /identity/v3/users/91a3dbd0e16041b78f8524fb8c38f808 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:46.658617 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:46.660055 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:46.673716 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c29f85-bdbb-4e19-8564-59c77d2464a0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:46.729825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:46.730452 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.730734 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.731009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] PATH_INFO: `/v3/projects/7cbd87280f384d9f9b3d32a1d14c8a2c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.732124 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbd87280f384d9f9b3d32a1d14c8a2c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:46.734064 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:46.754602 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:46.781395 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbd87280f384d9f9b3d32a1d14c8a2c', 'request_id': 'req-82f692b9-5a6a-43b3-ba17-631a942160eb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.786877 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbd87280f384d9f9b3d32a1d14c8a2c', 'request_id': 'req-82f692b9-5a6a-43b3-ba17-631a942160eb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.793498 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbd87280f384d9f9b3d32a1d14c8a2c', 'request_id': 'req-82f692b9-5a6a-43b3-ba17-631a942160eb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.806837 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] The token cache is being invalidate because project 7cbd87280f384d9f9b3d32a1d14c8a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:10:46.807189 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.808127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-82f692b9-5a6a-43b3-ba17-631a942160eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:10:46.814851 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1452/2929] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:10:46 2022] DELETE /identity/v3/projects/7cbd87280f384d9f9b3d32a1d14c8a2c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:46.816487 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdea35-87ed-4e7e-8ff0-6ca0e93e2964 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.816774 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdea35-87ed-4e7e-8ff0-6ca0e93e2964 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.817079 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdea35-87ed-4e7e-8ff0-6ca0e93e2964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.837640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-36bdea35-87ed-4e7e-8ff0-6ca0e93e2964 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:46.838826 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-36bdea35-87ed-4e7e-8ff0-6ca0e93e2964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:46.896004 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1478/2930] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 10 12:10:46.904613 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc42e-269f-43a2-a974-4478bac4187d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.904844 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc42e-269f-43a2-a974-4478bac4187d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.905180 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cc42e-269f-43a2-a974-4478bac4187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.926037 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4a5cc42e-269f-43a2-a974-4478bac4187d None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:46.927239 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4a5cc42e-269f-43a2-a974-4478bac4187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:46.935212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1453/2931] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:46.939453 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdea35-87ed-4e7e-8ff0-6ca0e93e2964 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:46.949470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdea35-87ed-4e7e-8ff0-6ca0e93e2964 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:46.954016 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:46.954602 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.954881 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.955154 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.955791 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 10 12:10:46.956119 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:46.957759 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:46.969395 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1479/2932] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 10 12:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 10 12:10:46.973769 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cc42e-269f-43a2-a974-4478bac4187d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:46.982775 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cc42e-269f-43a2-a974-4478bac4187d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:46.987436 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d0e70-c072-45b0-8245-d70ab94ab217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:46.988021 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0e70-c072-45b0-8245-d70ab94ab217 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:46.988300 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0e70-c072-45b0-8245-d70ab94ab217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:46.988568 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d0e70-c072-45b0-8245-d70ab94ab217 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:46.989219 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d0e70-c072-45b0-8245-d70ab94ab217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:46.991127 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d0e70-c072-45b0-8245-d70ab94ab217 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:47.017912 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1454/2933] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 10 12:10:46 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 10 12:10:47.021935 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:47.031990 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3a7a1-6ae3-48de-a551-e65a54a52184 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:47.086259 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15516c-d90f-40e1-a3dd-401ac2d188de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:47.086852 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15516c-d90f-40e1-a3dd-401ac2d188de admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:47.087129 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15516c-d90f-40e1-a3dd-401ac2d188de admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:47.087402 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15516c-d90f-40e1-a3dd-401ac2d188de admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:47.088008 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15516c-d90f-40e1-a3dd-401ac2d188de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:47.089957 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15516c-d90f-40e1-a3dd-401ac2d188de admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:47.111591 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1480/2934] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 10 12:10:47 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 10 12:10:47.115665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d0e70-c072-45b0-8245-d70ab94ab217 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:47.125960 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d0e70-c072-45b0-8245-d70ab94ab217 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:47.130833 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff303816-0469-4fe1-902e-fedc7469d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:47.131566 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303816-0469-4fe1-902e-fedc7469d35b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:47.131894 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303816-0469-4fe1-902e-fedc7469d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:47.132689 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303816-0469-4fe1-902e-fedc7469d35b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:47.133366 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff303816-0469-4fe1-902e-fedc7469d35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:47.134985 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff303816-0469-4fe1-902e-fedc7469d35b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:47.145338 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1455/2935] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:47.149920 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15516c-d90f-40e1-a3dd-401ac2d188de admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:47.159856 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15516c-d90f-40e1-a3dd-401ac2d188de admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:47.164343 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0365639-150b-4260-87db-d8eb0b9d4212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:47.164932 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365639-150b-4260-87db-d8eb0b9d4212 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:47.165240 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365639-150b-4260-87db-d8eb0b9d4212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:47.165511 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365639-150b-4260-87db-d8eb0b9d4212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:47.166142 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0365639-150b-4260-87db-d8eb0b9d4212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:47.167710 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0365639-150b-4260-87db-d8eb0b9d4212 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:47.177986 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1481/2936] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 10 12:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 10 12:10:47.181924 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff303816-0469-4fe1-902e-fedc7469d35b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:47.191684 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff303816-0469-4fe1-902e-fedc7469d35b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:47.196742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:47.197408 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:47.197685 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:47.197953 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] PATH_INFO: `/v3/projects/403f978049874761b29cffdbb0fb1077/users/2f206fefaf3844008adc48827f166970/roles/51dbfe81239845968f102b6b956c7061` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:47.212558 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403f978049874761b29cffdbb0fb1077, user_id=2f206fefaf3844008adc48827f166970, role_id=51dbfe81239845968f102b6b956c7061)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:47.215191 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:47.228008 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1456/2937] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 10 12:10:47 2022] PUT /identity/v3/projects/403f978049874761b29cffdbb0fb1077/users/2f206fefaf3844008adc48827f166970/roles/51dbfe81239845968f102b6b956c7061 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:10:47.232953 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ee19-7f16-427f-9cc5-da5c804cc219 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:47.233266 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ee19-7f16-427f-9cc5-da5c804cc219 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:47.233542 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ee19-7f16-427f-9cc5-da5c804cc219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:47.241572 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:47.254771 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-35a7ee19-7f16-427f-9cc5-da5c804cc219 None None] MFA Rules not processed for user `c765c31c0c1d406383a20f8e12957d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:47.255952 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-35a7ee19-7f16-427f-9cc5-da5c804cc219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:47.311966 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1482/2938] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:47.322020 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:47.323914 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:47.379972 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af1502-abb1-42bc-99eb-e85230f55734 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:47.384329 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:47.384936 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:47.385254 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:47.385528 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:47.394458 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:47.395876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:47.405150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1457/2939] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:48.013765 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aaa21-88a3-4831-a1c4-982c713e625b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:48.014612 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aaa21-88a3-4831-a1c4-982c713e625b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:48.014892 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aaa21-88a3-4831-a1c4-982c713e625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:48.043773 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-518aaa21-88a3-4831-a1c4-982c713e625b None None] MFA Rules not processed for user `2f206fefaf3844008adc48827f166970`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:48.045007 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-518aaa21-88a3-4831-a1c4-982c713e625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:48.110157 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1483/2940] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:48.120922 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:48.122328 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:48.181150 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:48.188022 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e506a-03fb-4597-8337-23c4c3f1c518 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:48.193100 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf7425-85dd-4272-8a62-1def8f0cbd00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb79c07e68446d19ac3aeb2279fd887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:48.193745 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7425-85dd-4272-8a62-1def8f0cbd00 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:48.194267 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7425-85dd-4272-8a62-1def8f0cbd00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:48.195476 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf7425-85dd-4272-8a62-1def8f0cbd00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:48.204931 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf7425-85dd-4272-8a62-1def8f0cbd00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:48.206377 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf7425-85dd-4272-8a62-1def8f0cbd00 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:48.215070 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1458/2941] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:49.572189 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4fbe-9259-4463-a71b-5772975b1d2a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:49.572691 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4fbe-9259-4463-a71b-5772975b1d2a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:49.572809 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4fbe-9259-4463-a71b-5772975b1d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:49.592028 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cf4b4fbe-9259-4463-a71b-5772975b1d2a None None] MFA Rules not processed for user `2f206fefaf3844008adc48827f166970`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:10:49.593245 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf4b4fbe-9259-4463-a71b-5772975b1d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:49.600505 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1484/2942] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:10:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:10:49.833781 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf7425-85dd-4272-8a62-1def8f0cbd00 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:10:49.843031 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf7425-85dd-4272-8a62-1def8f0cbd00 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:10:49.846587 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:10:49.847171 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:10:49.847448 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:10:49.847718 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:10:49.849710 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:10:49.859423 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:10:49.860820 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:10:49.869182 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1459/2943] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:10:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:10:59.586041 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=60 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:10:59.865137 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=11 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:02.376468 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a319-0462-4127-a6b1-784ec9a6d184 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:02.376925 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a319-0462-4127-a6b1-784ec9a6d184 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:02.377071 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a319-0462-4127-a6b1-784ec9a6d184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:02.395430 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6f55a319-0462-4127-a6b1-784ec9a6d184 None None] MFA Rules not processed for user `2f206fefaf3844008adc48827f166970`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:02.396649 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6f55a319-0462-4127-a6b1-784ec9a6d184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:02.403955 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1485/2944] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 10 12:11:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:02.633352 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:02.634920 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:02.645468 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4fd4-e1d7-48ce-aac1-56092d2c159d service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:02.649128 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1f548368994994a2966b7818e8b0e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:02.649726 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:02.650009 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:02.650283 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:02.651963 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:02.661439 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:02.662876 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:02.671350 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1460/2945] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:11:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:11:12.390161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:12.667660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:17.998471 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55487049-a5b9-4165-8cb4-d48099ee9fd4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:17.998979 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55487049-a5b9-4165-8cb4-d48099ee9fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:17.999086 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55487049-a5b9-4165-8cb4-d48099ee9fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:18.056520 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-55487049-a5b9-4165-8cb4-d48099ee9fd4 None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:18.057728 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-55487049-a5b9-4165-8cb4-d48099ee9fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:18.119870 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1486/2946] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 10 12:11:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:18.165594 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:18.167083 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:18.256598 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cfe71-a72f-4dee-80ba-57dad5715469 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:18.261742 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6edb62-8f47-4308-b070-06a992c2e4cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:18.262345 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edb62-8f47-4308-b070-06a992c2e4cc service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:18.262632 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edb62-8f47-4308-b070-06a992c2e4cc service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:18.262905 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edb62-8f47-4308-b070-06a992c2e4cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:18.270942 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6edb62-8f47-4308-b070-06a992c2e4cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:18.272541 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6edb62-8f47-4308-b070-06a992c2e4cc service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:18.281665 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1461/2947] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:11:28.116509 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=44 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:28.278720 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=41 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:32.730629 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375558e-105a-4741-baa4-ccd0187e29bc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:32.731111 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375558e-105a-4741-baa4-ccd0187e29bc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:32.731210 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375558e-105a-4741-baa4-ccd0187e29bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:32.751141 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6375558e-105a-4741-baa4-ccd0187e29bc None None] MFA Rules not processed for user `31d1decf1f0a47e3bfdb8f7cc8d3d98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 10 12:11:32.752305 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6375558e-105a-4741-baa4-ccd0187e29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:11:32.759161 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1487/2948] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 10 12:11:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 10 12:11:32.771027 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6edb62-8f47-4308-b070-06a992c2e4cc service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:32.781567 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6edb62-8f47-4308-b070-06a992c2e4cc service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:32.786573 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29530924-5ec7-47f7-9368-0e3506cdffcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa9fe4b8abc4a35b5d4540c3c9e3aa7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:32.787162 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29530924-5ec7-47f7-9368-0e3506cdffcd service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:32.787440 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29530924-5ec7-47f7-9368-0e3506cdffcd service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:32.787711 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29530924-5ec7-47f7-9368-0e3506cdffcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:32.796105 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29530924-5ec7-47f7-9368-0e3506cdffcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:32.797704 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29530924-5ec7-47f7-9368-0e3506cdffcd service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:32.809660 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1462/2949] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 10 12:11:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 10 12:11:34.705013 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375558e-105a-4741-baa4-ccd0187e29bc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.716386 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375558e-105a-4741-baa4-ccd0187e29bc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:34.720961 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:34.721698 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:34.721984 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:34.722254 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] PATH_INFO: `/v3/users/2f206fefaf3844008adc48827f166970` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:34.723371 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f206fefaf3844008adc48827f166970)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:34.725300 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:34.771477 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f206fefaf3844008adc48827f166970'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:34.783470 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f206fefaf3844008adc48827f166970'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:34.784140 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f206fefaf3844008adc48827f166970'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:34.791182 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f206fefaf3844008adc48827f166970'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:34.791794 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f206fefaf3844008adc48827f166970'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:34.808494 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1488/2950] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 10 12:11:34 2022] DELETE /identity/v3/users/2f206fefaf3844008adc48827f166970 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:34.983825 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29530924-5ec7-47f7-9368-0e3506cdffcd service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:11:34.995212 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29530924-5ec7-47f7-9368-0e3506cdffcd service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:11:35.051333 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c765c31c0c1d406383a20f8e12957d4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46b9ca29061a40d98972b8db835132e5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:11:35.051886 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:11:35.052166 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:11:35.052460 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] PATH_INFO: `/v3/projects/403f978049874761b29cffdbb0fb1077` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:11:35.053596 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403f978049874761b29cffdbb0fb1077)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:11:35.055512 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:11:35.100269 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403f978049874761b29cffdbb0fb1077', 'request_id': 'req-186722a7-f035-47c4-864a-8245de5683e8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:35.105925 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403f978049874761b29cffdbb0fb1077', 'request_id': 'req-186722a7-f035-47c4-864a-8245de5683e8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:35.111900 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403f978049874761b29cffdbb0fb1077', 'request_id': 'req-186722a7-f035-47c4-864a-8245de5683e8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:35.123976 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] The token cache is being invalidate because project 403f978049874761b29cffdbb0fb1077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 10 12:11:35.124291 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:35.124898 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-186722a7-f035-47c4-864a-8245de5683e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 10 12:11:35.126414 dv-cinder-850618-4-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1463/2951] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 10 12:11:34 2022] DELETE /identity/v3/projects/403f978049874761b29cffdbb0fb1077 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 10 12:11:44.800279 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:11:45.121073 dv-cinder-850618-4-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 12:12:50.600819 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 10 12:12:50.602344 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:50.670508 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad1e62-3000-4c83-afb3-bc2f13ef3920 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 10 12:12:50.728145 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68b6fe-e86c-47a7-8755-9349b0ebd9c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '397ce721f9684753b304f5c3b96c8a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9118f2e751384123a1ef0d81235be544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 10 12:12:50.728750 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b6fe-e86c-47a7-8755-9349b0ebd9c1 service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 10 12:12:50.729059 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b6fe-e86c-47a7-8755-9349b0ebd9c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 10 12:12:50.729331 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b6fe-e86c-47a7-8755-9349b0ebd9c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 10 12:12:50.731060 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fe68b6fe-e86c-47a7-8755-9349b0ebd9c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 10 12:12:50.742640 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b6fe-e86c-47a7-8755-9349b0ebd9c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 10 12:12:50.744197 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b6fe-e86c-47a7-8755-9349b0ebd9c1 service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 10 12:12:50.753859 dv-cinder-850618-4-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1489/2952] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 10 12:12:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 10 12:13:00.749706 dv-cinder-850618-4-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=58 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}